Next Article in Journal
Structure of Triangular Numbers Modulo m
Previous Article in Journal
Measuring Dependencies between Variables of a Dynamical System Using Fuzzy Affiliations
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

Verifying Measures of Quantum Entropy

1
Department of Communications and Networking, Aalto University, 02150 Espoo, Finland
2
Samsung SDS Research America, San Jose, CA 95134, USA
*
Author to whom correspondence should be addressed.
Submission received: 29 April 2022 / Revised: 1 June 2022 / Accepted: 8 June 2022 / Published: 17 June 2022

Abstract

:
This paper introduces a new measure of quantum entropy, called the effective quantum entropy (EQE). The EQE is an extension, to the quantum setting, of a recently derived classical generalized entropy. We present a thorough verification of its properties. As its predecessor, the EQE is a semi-strict quasi-concave function; it would be capable of generating many of the various measures of quantum entropy that are useful in practice. Thereafter, we construct a consistent estimator for our proposed measure and empirically test its estimation error, under different system dimensions and number of measurements. Overall, we build the grounds of the EQE, which will facilitate the analyses and verification of the next innovative quantum technologies.

1. Introduction

Quantum communication systems bring higher performance possibilities in terms of storage, processing, transmission, and security [1]. Therefore, when designing the new tools to assess the complexity or efficiency of these new systems, the quantum nature of the produced quantities needs to be taken into account. For this purpose, the fundamental notions of classical information theory and communication theory should be appropriately extended to the quantum setting and thoroughly analyzed. One of these key notions is entropy.
Beyond its value in communications, quantum entropy has found usage in statistical physics (e.g., in the ergodic theorem or irreversible systems) [2], quantum computing [3], among many other new systems. For instance, in quantum cryptography, the quantum entropy (or an estimator of it) could help to verify the proper behavior of the quantum random number generators [4]. Similarly, given the complex sampling process, appropriate estimators of the quantum entropy often appear in the literature. In Ref. [5], the degree of unpredictability of the hyper-chaotic and high-dimensional temporal fluctuations of the output of a semiconductor laser is quantified using an estimator of the permutation entropy, which is an exceptionally robust measure in noisy environments. In Ref. [6], the chaotic signals generated by vertical-cavity surface-emitting lasers is numerically investigated using a similar estimator of the permutation entropy. In Ref. [7], the complexity of the chaotic intensity obtained from an external-cavity semiconductor laser is also investigated via the sample entropy (SampEn) algorithm.
Therefore, the literature on classical and quantum entropy measures and their properties and applications is now extensive. Carlen [8] showed an elementary introduction to the subject of trace inequalities and related topics in analysis, with a particular focus on results that are relevant to quantum statistical mechanics. Wilde’s book [9], on the other hand, extensively surveyed the quantum information theory. Overall, numerous measures of classical entropy, and extensions to the quantum setting, have been introduced over the last few years:
Classical measures: Alfred Rényi proposed the Rényi entropy [10], which is a generalization of the Shannon entropy [11], by relaxing an axiom that characterizes it. That axiomatic approach has been beneficial and is summarized in a survey paper by Csiszar [12]. On the other hand, Constantino Tsallis introduced the entropy in a nonextensive direction [13] as a generalization of the traditional Boltzmann–Gibbs entropy. Américo et al. recently proposed a new generalizing framework for conditional entropies given concavity, core-concavity, or quasi-concavity [14]. In general, a helpful tool to construct a new type of entropy is convexity/or concavity. We refer to Cambini’s book [15] for many valuable properties of the generalized convexity.
Quantum measures: As the most relevant extension in the quantum setting, the most natural extension of the entropy is the well-known von Neuman entropy Tr ( ρ log ( ρ ) ) ; for a density operator characterizing a quantum system, denoted ρ [16]. There also exist quantum Rényi entropy ( 1 r ) 1 log ( Tr ( ρ r ) ) [17] by Muller et al. and quantum Tsallis entropy ( 1 r ) 1 log ( Tr ( ρ r ) 1 ) [18,19]; both with parameters r > 0 , r 1 . Following then axiomatic approaches surveyed on Csiszar’s [12] in the classical setting, there exist axiomatic characterizations with a minimum of conditions for entropy as a function on the set of states. As such, and more recently, other generalized measures have also been introduced. Hu et al. [20] introduced a generalized family of quantum entropies with nonnegativity, continuity, and concavity. However, their generalization failed to satisfy subadditivity and additivity. Baumgartner [21] presented a new axiomatic characterization with a minimum of conditions for entropy as a function on the set of states in quantum mechanics. Bosyk et al. [22] presented another family of generalized quantum entropies. Their generalization is relatively unified, so they established basic properties satisfied by other well-known quantum entropies such as von Neumann and quantum versions of Rényi and Tsallis entropies. Furthermore, Fan et al. [23] studied the monotonicity of the unified quantum entropy following the work of Hu et al. [20]. Slomczynski et al. [24] studied two information-theoretical invariants for the projective unitary group acting on a finite-dimensional complex Hilbert space: PVM- and POVM-dynamical quantum entropies. They quantified the maximal randomness of the successive quantum measurement results in the case of the evolution of the system between every two consecutive measurements. Moreover, Ref. [25] proved essential properties of the quantum relative entropy through axiomatic approaches, i.e., continuity in the first argument, the validity of the data-processing inequality, additivity under tensor products, and super-additivity. Ref. [26] also studied super-additivity of quantum relative entropy and provided an extension of this inequality for arbitrary density operators. Ref. [27] followed Csiszár’s approach [12] in classical information theory, and showed the quantum α -relative entropies with parameter α ( 0 , 1 ) .
All in all, three distinctive approaches could be adopted to generate new classical measures [28]. Simply put, the new measures could be derived from axioms or principles, they could be extrapolated from physical experiments, or they could be qualified using a checklist of properties. This paper will adopt the latter approach to generate a new measure of quantum entropy. Our objective is to contribute to the growing tools for analyzing new quantum systems. Our main contributions are two-folds:
A new measure of quantum entropy of EQE: Generalizing frameworks on entropy has a long history in information theory. Similar to our lines of generalization in quantum entropy, Pastor et al. [28] constructed a sparsity measure to quantify the simplicity of the system. Our construction of the EQE is motivated by this sparsity measure as an inverse to quantify the randomness of the quantum system. We call this measure the effective quantum entropy (EQE). The EQE is derived from the classical entropy proposed by Ref. [28]; and the EQE will inherit atypical properties from it, e.g., the EQE will be semistrict quasi-concave, thus revealing original insights. However, the EQE will also satisfy several of the typical properties of quantum entropy, such as unitary invariance or Schur concavity. One of the practical advantages of the EQE is its broad sensitivity, which two parameters could control.
A partially consistent estimator for the EQE: We could compute the von Neumann or Rényi entropy if a quantum state is known. However, when characterizing an unknown system or when one seeks to verify that a system is behaving as desired experimentally, we need to use an estimator [29]. The estimation for quantum Rényi entropy has been extended to the quantum system [30]. On the other hand, Lopes [31] studied a ratio form of an entropy in a classical setting. Ref. [31] introduced and studied the estimation of a family of entropy-based sparsity measures ( v q / v 1 ) q / ( 1 q ) parameterized by q [ 0 , ] , for a real vector v . For an unknown state, we estimate the EQE given independent measurements of the state. Since sampling a state can be quite costly, it is desirable to minimize the number of measurements that are required to estimate the entropy to a desired precision and confidence. As explained by Keyl and Werner [32], a quantum system cannot be measured on a single system unlike a classical probability distribution. It can be estimated on an ensemble sequence of identically designed systems. Suppose we could fully determine the density operator on a single quantum system. Then, we could connect the measurement with a device, equipping multiple identical systems with the measured density, contradicting the no-cloning theorem [33]. We thus adopt this complexity as our figure-of-merit. Therefore, we numerically show the EQE’s parameters’ effect on the sampling requirements.
The paper is organized as follows. First, Section 2 introduces the preliminaries, including the main notation. The section will also present our proposed measure of quantum entropy, called the effective quantum entropy (EQE). We will then list and demonstrate a large set of properties of the EQE in Section 3. In Section 4, we will construct a consistent estimator of the EQE. Finally, Section 5 will present our conclusions and recommendations for future research. Our primary notation is summarized in Table 1.

2. Proposed Measure

In the following, ρ r = ( T r | ρ | r ) 1 r denotes the Schatten-r pseudo-norm of matrices [8], ρ r = ( T r | ρ | r ) 1 r , for r [ 0 , ) , where T r ( . ) is the trace, and | . | is the component-wise absolute value.

2.1. Characterization of Classical Entropy

According to [28], a few distinctive approaches could be followed to generate new measures of classical entropy. In the quantum setting, that categorization holds. In brief, new measures of quantum entropy could be derived, proposed, or verified:
Axiomatic approach: New measures could be derived from the first principles. However, these principles could also impose strong requirements and produce fewer measures [34]. Examples include the von Neumman entropy, T r ( ρ log ( ρ ) ) [3,16], and the quantum entropy of type r, ( r 1 ) 1 ( ρ r 1 ) , with r > 0 , r 1 [35], which is an extension of the classical generalized entropy [36].
Operational approach: New measures could be designed to have a specific operational meaning in a physical or information-theoretic sense. However, the new measures could have a tight focus and serve only systems of similar nature as the one initially tested. Examples include the quantum min-entropy, log ρ , and quantum Hartley (max) entropy, log ρ 0 , which operational meaning was studied in the context of quantum systems in Ref. [37], and the quantum collision entropy, ρ 2 [17].
Verification approach: New measures could be proposed and then qualified as valid measures after verification of traditional properties. This approach could be innovative because the newly qualified measure could lead to atypical properties or original insights. Examples include the quantum Rényi entropy, ( 1 r ) 1 log ( ρ r r ) [17], and quantum Tsallis entropy ( 1 r ) 1 log ( ρ r r 1 ) [18], both with parameter r > 0 , r 1 .
In this paper, we will follow the third approach. Our problem then will consist of three steps. First, to select a relevant measure of classical entropy. Second, to extend the selected measure into the quantum setting. Moreover, third, to verify that the extended measure satisfies the fundamental properties of quantum entropy. We will complete the first two steps in the rest of this Section.

2.2. The Effective Quantum Entropy (EQE)

We start by adopting the recently derived effective entropy measure in Ref. [28], which generates numerous of the standard measures of classical entropy by fixing one or two of its parameters or by applying an increasing transformation. This is a measure of generalized entropy, which follows a quotient-of-functions functional form, h eff ( p ) = p α p β , 0 α 1 β , α β , where p denotes a probability mass function. Intuitively, if the vector p has k non-zero components, that is, if p is associated to a process producing k different outcomes, then, h eff ( p ) k 1 α 1 β by the Cauchy–Schwarz inequality, i.e., when k decreases or as the process becomes more certain, effective entropy decreases.
In quantum systems, a density operator, ρ , will play the role of a probability mass function, p , in the classical setting. In particular, the maximally mixing state will resemble the uniform distribution (i.e., where the probability mass is equally allocated among all of the possible outcomes), and the pure state will mimic the distribution of a constant variable (i.e., where all the probability mass is concentrated into one single outcome). Then, in order to extend the effective entropy to the quantum setting, we first proceed to replace the vector r-norm, . r , by the Schatten-r pseudo-norm of matrices. We are now ready to propose a new measure.
Definition 1
(Effective Quantum Entropy). The function,
H EQE ( ρ ) = ρ α ρ β , 0 α 1 β , α β ,
measures quantum entropy.
Similar to the effective entropy, the parameters α and β will tune the sensitiveness of the EQE. We will study the effect of both parameters later in Section 4. Before that, in the next Section 3, we will verify that the EQE satisfies the fundamental properties of quantum entropy. An essential tool in many of the proofs will be the notion of majorization. Let vectors, v and w , whose components, v i and w i , with i = 1 , , n , are set in decreasing order; it is said that “ v is majorized by w ”, denoted v w , when i = 1 k v i i = 1 k w i , for k = 1 , , n 1 , and i = 1 n v i = i = 1 n w i . Moreover, if the vectors do not share the same length, then, by convention, the shorter one is considered complete by zero entries. We require to extend this notion to operate with density operators (instead of with vectors). To do so, we exploit that the quantum entropy of density operators is given by the set of its eigenvalues [21]. Then, we claim that the majorization relationship between density operators will be given by their set of eigenvalues (which could be represented by vectors). Our primary notation is summarized in Table 1.

3. Properties of Quantum Entropy

The previous Section 2 introduced the preliminaries and the effective quantum entropy. In this Section, we will verify that the EQE satisfies the fundamental properties of quantum entropy. Other practical properties will be verified as well. Unless otherwise noted, the primary notation from Table 1 holds.

3.1. Fundamental Properties

Property 1
(Unitary invariance). Let σ = V ρ V , with V unitary, e.g., a rotation. Then, H EQE ( σ ) = H EQE ( ρ ) . In particular, let ρ = U Λ U and σ = V Λ V , with U , V unitary. Then, H EQE ( σ ) = H EQE ( ρ ) .
Proof. 
The result follows from the unitary invariance of the Schatten pseudo-norm. □
Property 2
(Schur concavity). Let ρ σ . Then, H EQE ( ρ ) H EQE ( σ ) , with equality if and only if σ = V ρ V , with V unitary.
Proof. 
Note that · r is a convex function when r 1 , and a concave one when r 1 . Then, if σ ρ , we have that ρ α σ α and ρ β σ β by ([38], Proposition 3-C.1). So
ρ α ρ β σ α σ β .
Therefore, the result follows. For the infinite-dimensional case, the result can be easily extended by following ([39], Property 2.2.7). □
Property 3
(Semicontinuity). It holds that H EQE ( ρ ) = sup σ { H EQE ( σ ) | ρ σ } .
Proof. 
Let ρ σ . Then H EQE ( ρ ) H EQE ( σ ) by Property 2. Now, by taking the supremum with respect to σ , sup σ , in both sides, we have that
H EQE ( ρ ) sup σ { H EQE ( σ ) | ρ σ } .
The equality is satisfied since ρ ρ . □
Property 4
(Semistrict quasiconcavity). Let ρ , σ such that H EQE ( ρ ) H EQE ( σ ) , and τ = c 1 ρ + ( 1 c 1 ) σ , with c 1 ( 0 , 1 ) . Then, H EQE ( τ ) > min { H EQE ( ρ ) , H EQE ( σ ) } .
Proof. 
The result follows by the functional form of H EQE , and ([15], Theorem 2.3.8), which characterizes the quasi-concavity of the ratio of functions. Essentially, ([15], Theorem 2.3.8) says that a function z ( x ) = f ( x ) / g ( x ) is semistrictly quasiconvex, if f is non-negative and convex, and g is positive and concave. □
Property 5
(Expansibility). Let ρ , σ with eigenvalues Λ = [ λ 1 , , λ n ] and Γ = [ λ 1 , , λ n , 0 ] , respectively. Then, H EQE ( σ ) = H EQE ( ρ ) .
Proof. 
The result directly follows from the notion of majorization and by its convention on different dimensions. □
These typical properties tell that the EQE is a semi-continuous and Schur concave function whose value depends on the eigenvalues of its argument. Besides this expected behavior, the EQE is semistrict quasi-concave, a new feature inherited from the classical effective entropy.

3.2. Other Properties

Property 6
(Concentration). Let ρ , σ with eigenvalues Λ = [ λ 1 , , λ n ] , and Γ = [ γ 1 , , γ n 1 ] , respectively, with γ 1 = λ 1 + λ 2 , and γ i = λ i + 1 , for i = 2 , , n 1 . Then, H EQE ( ρ ) H EQE ( σ ) .
Proof. 
Let τ with eigenvalues Γ = [ γ 1 , , γ n ] , with γ n = 0 . Then, H EQE ( τ ) = H EQE ( σ ) by Property 5. Note that
i = 1 k λ i i = 1 k γ i for k = 1 , , n 1 , and i = 1 n λ i = i = 1 n γ i .
This implies that Λ Γ . The result follows by Property 2. □
Property 7
(Monotonicity). Let ρ be a density operator with eigenvalues Λ = [ λ 1 , , λ n ] where for 0 c 2 a b c 1 and two indices j<k, λ j = a and λ k = c a , so 1 c = i j , k λ i . Let σ be a density operator with eigenvalues Γ = [ γ 1 , , γ n ] where γ i = λ i for i j , k , and γ j = b and γ k = c b . Then H EQE ( ρ ) H EQE ( σ ) .
Proof. 
Since λ j = a γ j = b , we have a majorization Λ Γ . The result follows by Property 2. □
Property 8
(Regularity). Let ρ be a density operator with largest eigenvalue, λ 1 λ i , for i 1 . And let σ = ρ + c 1 | e 1 e 1 | / ( 1 + c 1 ) and τ = ρ + d 1 | e 1 e 1 | / ( 1 + d 1 ) , where | e 1 is from an orthonormal basis of ρ and associated with the largest eigenvalue λ 1 , and 0 c 1 < d 1 . Then, H EQE ( σ ) H EQE ( τ ) .
Proof. 
The eigenvalues of σ are Λ : = [ λ 1 + c 1 , λ 2 , , λ n ] / ( 1 + c 1 ) , and the eigenvalues of τ are Γ = [ λ 1 + d 1 , λ 2 , , λ n ] / ( 1 + d 1 ) . Since λ 1 + c 1 1 + c 1 λ 1 + d 1 1 + d 1 , Λ Γ thus H EQE ( σ ) H EQE ( τ ) , by Property 2. □
Property 9
(Limits). Let μ , π be the maximally mixing and pure states. Then, H EQE ( π ) H EQE ( ρ ) H EQE ( μ ) . Moreover, in a finite dimension, | H EQE ( ρ ) | < .
Proof. 
For the first part of the inequality, note that π ρ μ , for any ρ , by [40]. The result follows by Property 2.
For the second part of the finite EQE, note that ρ β ρ α , for α β , by ([41], Proposition 6.11), i.e., 1 H EQE ( ρ ) . For the upper bound, assume that rank ( ρ ) < . Then,
H EQE ( ρ ) H EQE ( μ ) = ( ρ ) 1 α 1 β <
by applying the first part inequality. □
Property 10
(Homogeneous growth). Let ρ I n , and σ = ρ + c 1 I n , with c 1 > 0 . Then, H EQE ( σ ) > H EQE ( ρ ) .
Proof. 
Let τ = c 2 ρ + ( 1 c 2 ) I n , with c 2 = 1 1 + c 1 < 1 , because c 1 > 0 . First, H EQE ( τ ) = H EQE ( σ ) , by Property 1. Then,
H EQE ( σ ) > min { H EQE ( ρ ) , H EQE ( I n ) }
by Property 4. Note that I n is a maximally mixing operator. Therefore, H EQE ( σ ) > H EQE ( ρ ) by Property 9. □
The next property is about acting a bistochasic operator. An operator E between two finite dimensional densities is called bistochastic if given an orthonormal basis { | e i } i = 1 n , E can be represented as E = i , j = 1 n E i , j | e i e j | with i E i , j = 1 and j E i , j = 1 .
Property 11
(Bistochastic operator). Let σ = E ( ρ ) , with E a bistochastic operator. Then, H EQE ( σ ) H EQE ( ρ ) , with equality if and only if E ( ρ ) = V ρ V for unitary V.
Proof. 
By the quantum Hardy–Littlewood–Pólya theorem, σ ρ ([42], Lemma 12.1). Then, the result follows by Property 2. □
Property 12
(Mixture). Let ρ with eigenvalues Λ = [ λ 1 , , λ n ] with orthornormal basis { | e i } i = 1 n , and σ = i = 1 n λ i | ψ i ψ i | be a mixture of arbitrary rank-one densities π i = | ψ i ψ i | . Then, H EQE ( ρ ) H EQE ( σ ) .
Proof. 
By Schrödinger mixture theorem [42,43] (Theorem 8.2 in Ref. [42]), there exists a bistochastic map E such that σ = E ( ρ ) . Then, Λ Γ by Property 11. The result follows by Property 2. □
The next property is about POVM (positive operator-valued measurement), which is a collection of { E i } of positive definite operators such that i = 1 m E i = I n . Suppose that the measurement M i from E i = M i M i is performed upon a system in the state | ψ i . For more details, see Section 2.2.6 in [3].
Property 13
(POVM). Let σ be an operator on an arbitrary orthonormal basis { | e i } i = 1 n with eigenvalues γ i E ( ρ ) = ( E i ρ ) where E = { E i } i = 1 m is a rank-one POVM. Then, H EQE ( σ ) H EQE ( ρ ) . Moreover, H EQE ( ρ ) = min E E H EQE ( σ ) , E E , where E is the set of all rank-one POVMs.
Proof. 
For any rank-one POVM E = { E i } i = 1 m , there exist unitary operators U i such that M i = U i E i , where E i is the POVM to the measurement ([3] Exercise 2.63). Then M i = M i . Let
E E ( ρ ) = i = 1 m M i ρ M i = i = 1 m γ i E ( ρ ) M i ρ M i T r ( E i ρ ) = i = 1 m γ i E ( ρ ) | ψ i ψ i | ,
where | ψ i is a normalized pure state from M i since E i is a rank-one operator. Then since i = 1 m E i = I n , E E ( ρ ) is a bistochastic operator. Therefore, the first inequality follows from Property 11.
H EQE ( σ ) H EQE ( ρ ) .
For the second property, since E can be arbitrary rank-on POVM,
H EQE ( ρ ) min E E H EQE ( σ ) .
If we consider E * = | e i e i | i = 1 n where | e i i = 1 n is an orthonormal basis that diagonalizes ρ . Then E * is a rank-one POVM. Therefore the equality holds. c.f., see the proof of ([22], Proposition 8). □
Property 14
(Reparametrization). Let σ be a density operator with eigenvalues γ i = e i | ρ | e i by acting on an arbitrary orthonormal basis { | e i } i = 1 n . Then, H EQE ( σ ) H EQE ( ρ ) .
Proof. 
We can decompose ρ with the orthonormal basis { | e i } i = 1 n into the form ρ = i , j = 1 n ρ i , j | e i e j | where the diagonal terms are ρ i , i = γ i . Therefore, we can apply the Schur–Horn theorem [44,45] implying that γ i ’s of diagonal terms of ρ and the eigenvalues of σ is majorized by the eigenvalues of ρ , i.e., σ ρ . Then the proof follows by Property 2. c.f., see Proposition 5 in [22]. □
Property 15
(Core-concavity). Let ρ , σ such that, H EQE ( σ ) < H EQE ( ρ ) . Then, Θ H EQE ( σ ) < Θ H EQE ( ρ ) , for any increasing transformation Θ.
Proof. 
The result follows from the monotonicity of increasing functions, c.f., proof of ([46], Property 9). □
These other properties illustrate the response of the EQE when its argument is sparsified (i.e., the probability mass is concentrated in few, or even one possible outcome) or democratized (i.e., the probability mass is spread along any or all of the possible outcomes). Overall, these properties bring practical insights into the dynamics of the EQE.

3.3. Specific Properties of Composite Operators

Property 16
(Replication). Let σ = ρ ρ (r-repeated states). Then, H EQE ( σ ) > H EQE ( ρ ) . In particular, let μ ˜ be the maximally mixing state of dimension n ˜ , with n ˜ > n . Then, H EQE ( μ ˜ ) > H EQE ( μ ) .
Proof. 
Let τ with eigenvalues Ξ = [ ξ 1 , , ξ r n ] , with ξ i = λ i , for i = 1 , , n and ξ j = 0 , for j = n + 1 , , r n . Then, H EQE ( τ ) = H EQE ( ρ ) by Property 5.
Note that the eigenvalues of σ are Γ = [ γ 1 , , γ r n ] , with γ i + j n = λ i r for i = 1 , , n , j = 0 , , r 1 . This implies that i = 1 k 1 γ i i = 1 k 1 ξ i , for k = 1 , , r n and i = 1 r n γ i = i = 1 r n ξ i , i.e., Γ Ξ . The result follows by Property 2. □
Property 17
(Decomposition). Let π be the pure state, and σ = ρ π . Then, H EQE ( σ ) = H EQE ( ρ ) .
Proof. 
Let ρ = U Λ U , π = V Π V , with U , V unitary, and Π 11 = 1 , Π i j = 0 elsewhere. Then ρ π = ( U v e 1 ) Λ ( U v e 1 ) , with v i = V i 1 . The result follows by Property 1. □
Property 18
(Composite pure). Let π = ρ σ be a composite pure state. Then, H EQE ( σ ) = H EQE ( ρ ) .
Proof. 
Applying the Schmidt decomposition ([42], Theorem 9.1), for any pure state ψ in ρ σ , we have
| ψ = i = 1 n λ i | e i | e i ,
where { e i } i = 1 n ρ and { e i } i = 1 n σ are orthonormal bases in ρ and σ , and note that n = min { n ρ , n σ } where n ρ and n σ are dimensions of operators ρ and σ . Therefore ρ and σ should have the forms:
ρ = i = 1 n λ i | e i e i | , and σ = i = 1 n λ i | e i e i | .
Therefore, the eigenvalues of ρ and σ should be the same. Then the result follows by definition. c.f., see the proofs of ([20], Proposition 8) or ([22], Proposition 13). □
We finish this Section by showing how the proposed fundamental properties of the EQE, and other derived properties, are also obeyed by the classical quantum entropy. Previous research works have proposed and extensively studied the inherent properties of classical quantum entropy [20,21,22], namely the unitary invariance, Schur concavity, semicontinuity and expansibility (Properties 1, 2, 3, and 5, respectively). Remarkably, most of the other properties proposed in this work (Properties 6–15), could be derived using the Schur concavity of the EQE. Table 2 shows this mapping between our proposed properties to axioms, propositions, and properties by previous research. Granted, the originality and novelty of this work is based on the Property 4, which introduces the quasi-concavity nature of the quantum entropy. However, although the EQE verifies typical properties of composite states (Properties 16–18), the additivity properties for independent systems and subadditivity will not generally hold (except when one parameter is set equal to 1 and the other approaches 1). Nonetheless, numerical experiments suggested a tight bound that is worth further investigation.
Conjecture 1
(Arithmetic Mean). The proposed EQE would hold the following arithmetic mean property.
H EQE ( ρ σ ) ρ 1 ρ σ 1 H EQE ( ρ ) + σ 1 ρ σ 1 H EQE ( σ ) .
The next Section 4 will present an application example. We will discuss how to estimate the EQE of unknown systems in practice.

4. Numerical Experiments

In the estimation of EQE, the main challenge comes from the treatment of the ratio of two norms. Lopes [31] studied an estimation of the ratio of two norms in a sparsity setting, but it does not fit into the quantum setting because of different measurement procedures. For the quantum Rényi entropy with a parameter α > 0 , Acharya et al. [30] extensively studied the error bound of the Schur estimator for integral α ’s and the natural Empirical Young Diagram (EYD) estimator [32,47,48] for non-integral α > 0 . For simplicity, we adopt the natural EYD estimator analyzed in Ref. [30] for any α , β > 0 . The analysis of the error bounds is beyond the scope of this paper. Instead, we illustrate the empirical performance of estimation errors by applying the EYD algorithm for any α , β > 0 .

EYD Algorithm

The EYD algorithm is a natural and the most straightforward way of estimating a spectrum of an operator ρ . As discussed in [30], it is a quantum analog of the classical empirical estimator. Let m be the number of observations, and γ i be the number of observations of the state i. (1) For each symbol i, find the empirical distribution γ i m , (2) return an operator ρ ^ of the mixed state with eigenvalues of γ i m . Then we estimate the α -norm of ρ ^ as follows:
ρ ^ r = γ i m r 1 / r .
Therefore, our EQE estimator can be given by H EQE ρ ^ = ρ ^ α ρ ^ β . In general, we cannot guarantee the unbiasedness or the consistency of EYD estimator for our EQE.
Property 19.
The EYD estimator is not an unbiased estimator in general.
E γ i m α λ i α for α 1 , E γ i m β λ i β for β 1 .
Proof. 
Jensen’s inequality implies both inequalities because E γ i m = λ i for each i = 1 , , n . □
However, if we fix β = 1 , it is similar to the classical Rényi entropy, but we have an additional exponent 1 / α outside the summation. We can prove that it is still consistent.
Property 20.
H EQE ρ ^ is consistent when β = 1 .
Proof. 
For α = 1 , it is true because i γ i m = i λ i = 1 . From Lemma 20 in [30] (or applying the triangle inequality), we have when α < 1 ,
E i γ i m α i λ i α O 1 m α 2 .
Then for a sufficiently large constant C ( t ) > 0 not depending on m,
P i γ i m α 1 / α i λ i α 1 / α > t P C ( t ) i γ i m α i λ i α > t α
C ( t ) E i γ i m α i λ i α t α
O 1 m α 2 ,
where (17) is by applying Markov’s inequality, and (18) is from (15). Then the proof follows by taking m .
For (16), let Γ m : = i γ i m α 1 / α and λ : = i λ i α 1 / α . We know that 0 λ n 1 / α . Then
Γ m λ > t = Γ m > λ + t Γ m < λ t , and
C ( t ) Γ m α λ α > t α = Γ m > λ α + t α C ( t ) 1 / α Γ m < λ α t α C ( t ) 1 / α .
For a sufficiently large C ( t ) > 0 not depending on m, since λ lies in a compact domain, we can have λ + t λ α + t α C ( t ) 1 / α and λ t λ α t α C ( t ) 1 / α . This means
Γ m > λ + t Γ m > λ α + t α C ( t ) 1 / α , and
Γ m < λ t Γ m < λ α t α C ( t ) 1 / α ,
implying that Γ m λ > t C ( t ) Γ m α λ α > t α . Therefore (16) holds. □
Then, Table 3 and Figure 1 show the behavior of the empirical L1-error of the EYD estimator of EQE. i.e., L 1 - error = | H EQE ρ ^ H EQE ρ | . We report the number of required measurements to achieve a target L1-error given the dimension of ρ for various choices of α and β ’s. For fixed 0 α 1 and β 1 , as the dimension increases, it requires more measurements to achieve the same L1-error, as expected. For fixed α 1 and the dimension, it tends to require more measurements to achieve the same L1-error as β increase. For fixed β 1 , it requires less measurements as α increases.

5. Conclusions

In recent years, the measures to compute quantum entropy have been formulated from their counterparts in the classical setting. Similarly, a recently derived classical entropy has enabled a new formulation in this paper. We have introduced and demonstrated the effective quantum entropy (EQE). Like its predecessor, the EQE inherits a functional form, which conceptually unifies quotients of functions that have been repeatedly observed in the literature.
Lastly, quantum entropy is a central notion in modern (quantum) systems, aiming to exploit the large-dimension and correlation of underlying random processes. Granted, the possibilities for future research from this paper are extensive. An extension of EQE to relative and conditional quantum entropy would be desirable. It would also be interesting to explore how EQE can be efficiently optimized in democracy sensing algorithms. To that end, the work presented in this paper suggests new insights into the dynamics and properties of quantum entropy that may benefit the design of algorithms.

Author Contributions

Conceptualization, G.P.; methodology, G.P. and J.-O.W.; validation, G.P. and J.-O.W.; formal analysis, G.P. and J.-O.W.; investigation, G.P. and J.-O.W.; writing—review and editing, G.P. and J.-O.W.; visualization, J.-O.W. All authors have read and agreed to the published version of the manuscript.

Funding

This research received no external funding.

Institutional Review Board Statement

Not applicable.

Informed Consent Statement

Not applicable.

Data Availability Statement

Not applicable.

Conflicts of Interest

The authors declare no conflict of interest.

References

  1. Imre, S. Quantum communications: Explained for communication engineers. IEEE Commun. Mag. 2013, 51, 28–35. [Google Scholar] [CrossRef]
  2. Ohya, M.; Watanabe, N. Quantum Entropy and Its Applications to Quantum Communication and Statistical Physics. Entropy 2010, 12, 1194–1245. [Google Scholar] [CrossRef]
  3. Nielsen, M.A.; Chuang, I.L. Quantum computing and quantum information. Am. J. Phys. 2002, 70, 558. [Google Scholar] [CrossRef] [Green Version]
  4. Montalvão, J. Noise Variance Estimation Through Joint Analysis of Intrinsic Dimension and Differential Entropy. IEEE Signal Process. Lett. 2019, 26, 1330–1333. [Google Scholar] [CrossRef]
  5. Zunino, L.; Rosso, O.A.; Soriano, M.C. Characterizing the Hyperchaotic Dynamics of a Semiconductor Laser Subject to Optical Feedback Via Permutation Entropy. IEEE J. Sel. Top. Quantum Electron. 2011, 17, 1250–1257. [Google Scholar] [CrossRef] [Green Version]
  6. Xiang, S.Y.; Pan, W.; Yan, L.S.; Luo, B.; Zou, X.H.; Jiang, N.; Wen, K.H. Quantifying Chaotic Unpredictability of Vertical-Cavity Surface-Emitting Lasers With Polarized Optical Feedback via Permutation Entropy. IEEE J. Sel. Top. Quantum Electron. 2011, 17, 1212–1219. [Google Scholar] [CrossRef]
  7. Li, N.; Pan, W.; Xiang, S.; Zhao, Q.; Zhang, L.; Mu, P. Quantifying the Complexity of the Chaotic Intensity of an External-Cavity Semiconductor Laser via Sample Entropy. IEEE J. Quantum Electron. 2014, 50, 1–8. [Google Scholar] [CrossRef]
  8. Carlen, E. Trace Inequalities and Quantum Entropy: An Introductory Course. Contemp. Math. 2009, 529, 73–140. [Google Scholar]
  9. Wilde, M.M. From classical to quantum Shannon theory. arXiv 2019, arXiv:1106.1445. [Google Scholar]
  10. Rényi, A. On measures of entropy and information. In Proceedings of the Fourth Berkeley Symposium on Mathematical Statistics and Probability, Berkeley, CA, USA, June 20–July 30 1960; University of California Press: Berkeley, CA, USA, 1961; Volume 1, pp. 547–561. [Google Scholar]
  11. Shannon, C.E. A mathematical theory of communication. Bell Syst. Tech. J. 1948, 27, 379–423. [Google Scholar] [CrossRef] [Green Version]
  12. Csiszar, I. Axiomatic Characterizations of Information Measures. Entropy 2008, 10, 261–273. [Google Scholar] [CrossRef] [Green Version]
  13. Tsallis, C. Possible generalization of Boltzmann-Gibbs statistics. J. Stat. Phys. 1988, 52, 479–487. [Google Scholar] [CrossRef]
  14. Américo, A.; Malacaria, P. Concavity, Core-concavity, Quasiconcavity: A Generalizing Framework for Entropy Measures. In Proceedings of the 2021 IEEE 34th Computer Security Foundations Symposium (CSF), Dubrovnik, Croatia, 21–25 June 2021; pp. 1–14. [Google Scholar]
  15. Cambini, A.; Martein, L. Generalized Convexity and Optimization; Springer: Berlin/Heidelberg, Germany, 2009; Volume 616. [Google Scholar]
  16. Wehrl, A. General properties of entropy. Rev. Mod. Phys. 1978, 50, 221. [Google Scholar] [CrossRef]
  17. Müller-Lennert, M.; Dupuis, F.; Szehr, O.; Fehr, S.; Tomamichel, M. On quantum Rényi entropies: A new generalization and some properties. J. Math. Phys. 2013, 54, 122203. [Google Scholar] [CrossRef] [Green Version]
  18. Jankovic, M.V. Quantum Tsallis entropy and projective measurement. arXiv 2009, arXiv:0904.3794. [Google Scholar]
  19. Petz, D.; Virosztek, D. Some inequalities for quantum Tsallis entropy related to the strong subadditivity. arXiv 2014, arXiv:1403.7062. [Google Scholar] [CrossRef] [Green Version]
  20. Hu, X.; Ye, Z. Generalized quantum entropy. J. Math. Phys. 2006, 47, 023502. [Google Scholar] [CrossRef]
  21. Baumgartner, B. Characterizing Entropy in Statistical Physics and in Quantum Information Theory. Found. Phys. 2014, 44, 1107–1123. [Google Scholar] [CrossRef] [Green Version]
  22. Bosyk, G.; Zozor, S.; Holik, F. A family of generalized quantum entropies: Definition and properties. Quantum Inf. Process. 2016, 15, 3393–3420. [Google Scholar] [CrossRef] [Green Version]
  23. Fan, Y.; Cao, H. Monotonicity of the unified quantum (r, s)-entropy and (r, s)-mutual information. Quantum Inf. Process 2015, 14, 4537–4555. [Google Scholar] [CrossRef]
  24. Slomczynski, W.; Szczepanek, A. Quantum Dynamical Entropy, Chaotic Unitaries and Complex Hadamard Matrices. IEEE Trans. Inf. Theory 2017, 63, 7821–7831. [Google Scholar] [CrossRef] [Green Version]
  25. Wilming, H.; Gallego, R.; Eisert, J. Axiomatic Characterization of the Quantum Relative Entropy and Free Energy. Entropy 2017, 19, 241. [Google Scholar] [CrossRef] [Green Version]
  26. Capel, A.; Lucia, A.; Perez-Garcia, D. Superadditivity of Quantum Relative Entropy for General States. IEEE Trans. Inf. Theory 2018, 64, 4758–4765. [Google Scholar] [CrossRef] [Green Version]
  27. Mosonyi, M.; Hiai, F. On the quantum Rényi relative entropies and related capacity formulas. IEEE Trans. Inf. Theory 2011, 57, 2474–2487. [Google Scholar] [CrossRef]
  28. Pastor, G.; Mora-Jimenez, I.; Jantti, R.; Caamano, A. Constructing Measures of Sparsity. IEEE Trans. Knowl. Data Eng. 2022, 34. [Google Scholar] [CrossRef]
  29. Lim, M.H.; Yuen, P.C. Entropy Measurement for Biometric Verification Systems. IEEE Trans. Cybern. 2016, 46, 1065–1077. [Google Scholar] [CrossRef]
  30. Acharya, J.; Issa, I.; Shende, N.V.; Wagner, A.B. Estimating Quantum Entropy. IEEE J. Sel. Areas Inf. Theory 2020, 1, 454–468. [Google Scholar] [CrossRef]
  31. Lopes, M.E. Unknown Sparsity in Compressed Sensing: Denoising and Inference. IEEE Trans. Inf. Theory 2016, 62, 5145–5166. [Google Scholar] [CrossRef] [Green Version]
  32. Keyl, M.; Werner, R.F. Estimating the spectrum of a density operator. In Asymptotic Theory Of Quantum Statistical Inference: Selected Papers; World Scientific: Singapore, 2005; pp. 458–467. [Google Scholar]
  33. Wootters, W.K.; Zurek, W.H. A single quantum cannot be cloned. Nature 1982, 299, 802–803. [Google Scholar] [CrossRef]
  34. Cowell, F.A. Theil, Inequality and the Structure of Income Distribution. In Distributional Analysis Research Programme 67; London School of Economics and Political Science: London, UK, 2003. [Google Scholar]
  35. Audenaert, K.M.R. Subadditivity of q-entropies for q > 1. J. Math. Phys. 2007, 48, 083507. [Google Scholar] [CrossRef] [Green Version]
  36. Shorrocks, A.F. The class of additively decomposable inequality measures. Econometrica 1980, 48, 613–625. [Google Scholar] [CrossRef] [Green Version]
  37. Konig, R.; Renner, R.; Schaffner, C. The Operational Meaning of Min- and Max-Entropy. IEEE Trans. Inf. Theory 2009, 55, 4337–4347. [Google Scholar] [CrossRef] [Green Version]
  38. Marshall, A.W.; Olkin, I.; Arnold, B.C. Inequalities: Theory of Majorization and Its Applications; Springer Science & Business Media: Berlin/Heidelberg, Germany, 2010. [Google Scholar]
  39. Woo, J.O. Information Theoretic Inequalities, Limit Theorems, and Universal Compression over Unknown Alphabets. Ph.D. Thesis, Yale University, New Haven, CT, USA, 2015. [Google Scholar]
  40. Cicalese, F.; Vaccaro, U. Supermodularity and subadditivity properties of the entropy on the majorization lattice. IEEE Trans. Inf. Theory 2002, 48, 933–938. [Google Scholar] [CrossRef]
  41. Folland, G.B. Real Analysis: Modern Techniques and Their Applications; John Wiley & Sons: Hoboken, NJ, USA, 1999; Volume 40. [Google Scholar]
  42. Bengtsson, I.; Życzkowski, K. Geometry of Quantum States: An Introduction to Quantum Entanglement; Cambridge University Press: Cambridge, UK, 2017. [Google Scholar]
  43. Nielsen, M.A. Probability distributions consistent with a mixed state. Phys. Rev. A 2000, 62, 052308. [Google Scholar] [CrossRef] [Green Version]
  44. Schur, I. Uber eine Klasse von Mittelbildungen mit Anwendungen auf die Determinantentheorie. Sitzungsberichte Der Berl. Math. Ges. 1923, 22, 51. [Google Scholar]
  45. Horn, A. Doubly stochastic matrices and the diagonal of a rotation matrix. Am. J. Math. 1954, 76, 620–630. [Google Scholar] [CrossRef]
  46. Martin, J.; Mayor-Forteza, G.; Suner, J. On Dispersion Measures. Mathw. Soft Comput. 2001, 8, 227–237. [Google Scholar]
  47. Alicki, R.; Rudnicki, S.; Sadowski, S. Symmetry properties of product states for the system of N n-level atoms. J. Math. Phys. 1988, 29, 1158–1162. [Google Scholar] [CrossRef]
  48. Christandl, M.; Mitchison, G. The spectra of quantum states and the Kronecker coefficients of the symmetric group. Commun. Math. Phys. 2006, 261, 789–797. [Google Scholar] [CrossRef] [Green Version]
Figure 1. EQE estimation error contour plots for various α and β ’s. We interpolate the curve on non-integer grid points over both dimension and number of measurements for a better visualization. We fix L 1 - error = 0.5 (lower band), L 1 - error = 0.75 (middle line), and L 1 - error = 1.0 (upper band) for illustrating the error-range.
Figure 1. EQE estimation error contour plots for various α and β ’s. We interpolate the curve on non-integer grid points over both dimension and number of measurements for a better visualization. We fix L 1 - error = 0.5 (lower band), L 1 - error = 0.75 (middle line), and L 1 - error = 1.0 (upper band) for illustrating the error-range.
Appliedmath 02 00019 g001
Table 1. Summary of the main notation.
Table 1. Summary of the main notation.
SymbolDescription
. p Schatten p-(pseudo-)norm of matrices
. . concatenation of vectors
. . majorization pre-order of density operators
α , β parameters of the EQE, H eq ( . )
Θ ( . ) increasing function
π ( . ) permutation (component-wise) of vectors
H eq ( . ) effective quantum entropy (EQE)
h eff ( . ) effective (classical) entropy
sign ( . ) sign (component-wise) of vectors
v , v i , v j vector (in bold) and its components
ρ , σ , τ density operators
μ , π maximally mixing and pure state, respectively
U , V , W unitary matrices
( . ) conjugate transpose (or Hermitian transpose)
Tr ( . ) trace of matrices
log ( . ) natural logarithm of matrices
v probability mass function vector
| . | component-wise absolute value
c 1 , , c 5 scalar (real numbers)
sup ( . ) supremum operator
. . tensor product
Table 2. Mapping of the proposed properties to axioms, propositions, and properties by previous works.
Table 2. Mapping of the proposed properties to axioms, propositions, and properties by previous works.
Proposed PropertiesPreviously Adopted Properties
Fundamental properties:
Property 1([21], Axiom B), ([22], Property 6)
Property 1 (second part)([21], Property 1)
Property 2([20], Property 5), ([21], Axiom C’), ([22], Property 1)
Property 3([21], Axiom F’)
Property 4
Property 5[22]
Other properties:
Property 6[22]
Property 7
Property 8
Property 9([20], Propositions 1 and 2), ([22], Proposition 2)
Property 10
Property 11([22], Property 7)
Property 12([22], Property 4)
Property 13([22], Proposition 8)
Property 14([22], Proposition 5)
Property 15
Specific to composite operators:
Property 16([21], Axiom C)
Property 17([21], Axiom A)
Property 18([20], Proposition 8),  ([22], Proposition 13)
Table 3. The required number of measurement samples scaled by log 10 to achieve a target estimation L1-error for various α and β values. The value > 9.0 means that we are not able to find a proper number of measurements since it requires a large memory for simulation.
Table 3. The required number of measurement samples scaled by log 10 to achieve a target estimation L1-error for various α and β values. The value > 9.0 means that we are not able to find a proper number of measurements since it requires a large memory for simulation.
log 10 (# of Measurement Samples)
Case Dimension L1-Error α = 0 . 2 α = 0 . 3 α = 0 . 4 α = 0 . 5 α = 0 . 6 α = 0 . 7 α = 0 . 8 α = 0 . 9 α = 1 . 0
β = 2.0 2 0.5 2.98 2.12 1.61 1.37 1.16 1.04 0.61 0.30 0.30
0.75 2.79 1.92 1.44 1.16 0.87 0.61 0.30 0.30 0.30
1.0 2.67 1.80 1.34 1.04 0.61 0.30 0.30 0.30 0.30
4 0.5 4.16 3.06 2.38 2.05 1.83 1.57 1.32 1.04 0.91
0.75 3.97 2.88 2.21 1.85 1.63 1.39 1.08 0.91 0.61
1.0 3.85 2.74 2.07 1.71 1.49 1.22 0.91 0.61 0.30
8 0.5 6.17 5.35 3.32 2.79 2.34 2.16 1.93 1.69 1.47
0.75 5.92 5.51 3.10 2.62 2.17 1.93 1.73 1.45 1.20
1.0 5.79 5.45 2.98 2.48 2.05 1.78 1.56 1.27 1.00
β = 10.0 2 0.5 3.99 3.05 2.43 2.12 1.88 1.75 1.59 1.35 1.15
0.75 3.80 2.86 2.24 1.90 1.47 1.42 1.27 0.91 0.61
1.0 3.68 2.70 2.07 1.69 1.25 1.13 0.91 0.30 0.30
4 0.5 5.27 4.00 3.49 3.08 2.91 2.62 2.45 2.31 2.09
0.75 5.08 3.80 3.23 2.89 2.65 2.38 2.19 2.02 1.83
1.0 4.95 3.68 3.05 2.72 2.48 2.17 2.00 1.81 1.59
8 0.5 7.13 6.35 5.89 4.09 3.66 3.34 3.20 3.03 2.93
0.75 6.94 6.17 5.38 3.87 3.42 3.15 3.00 2.81 2.67
1.0 6.53 5.73 4.55 3.71 3.27 3.03 2.84 2.64 2.45
β = + 2 0.5 5.43 4.23 3.23 2.60 2.33 2.14 1.87 1.73 1.52
0.75 5.25 3.87 2.88 2.23 1.88 1.63 1.34 1.10 1.06
1.0 5.18 3.56 2.55 2.02 1.54 1.20 0.96 0.78 0.48
4 0.5 8.34 6.84 4.96 4.35 3.83 3.44 3.20 3.08 2.91
0.75 8.19 6.58 4.54 4.00 3.44 3.06 2.82 2.64 2.48
1.0 7.80 6.15 4.28 3.66 3.17 2.82 2.55 2.31 2.14
8 0.5 > 9.0 > 9.0 7.15 6.70 6.13 5.38 4.59 4.26 4.07
0.75 > 9.0 8.71 6.92 6.41 5.39 4.52 4.12 3.94 3.63
1.0 > 9.0 8.28 6.35 5.84 4.78 4.24 3.85 3.70 3.32
Publisher’s Note: MDPI stays neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Share and Cite

MDPI and ACS Style

Pastor, G.; Woo, J.-O. Verifying Measures of Quantum Entropy. AppliedMath 2022, 2, 312-325. https://0-doi-org.brum.beds.ac.uk/10.3390/appliedmath2020019

AMA Style

Pastor G, Woo J-O. Verifying Measures of Quantum Entropy. AppliedMath. 2022; 2(2):312-325. https://0-doi-org.brum.beds.ac.uk/10.3390/appliedmath2020019

Chicago/Turabian Style

Pastor, Giancarlo, and Jae-Oh Woo. 2022. "Verifying Measures of Quantum Entropy" AppliedMath 2, no. 2: 312-325. https://0-doi-org.brum.beds.ac.uk/10.3390/appliedmath2020019

Article Metrics

Back to TopTop