Next Article in Journal
On New Matrix Version Extension of the Incomplete Wright Hypergeometric Functions and Their Fractional Calculus
Next Article in Special Issue
Bootstrapping Not Independent and Not Identically Distributed Data
Previous Article in Journal
A New Fractal-Fractional Version of Giving up Smoking Model: Application of Lagrangian Piece-Wise Interpolation along with Asymptotical Stability
Previous Article in Special Issue
Statistical Inference for Competing Risks Model with Adaptive Progressively Type-II Censored Gompertz Life Data Using Industrial and Medical Applications
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

A Look at the Primary Order Preserving Properties of Stochastic Orders: Theorems, Counterexamples and Applications in Cognitive Psychology

by
Mohsen Soltanifar
1,2,3,†
1
Biostatistics Division, Dalla Lana School of Public Health, University of Toronto, 620-155 College Street, Toronto, ON M5T 3M7, Canada
2
Analytics Division, College of Professional Studies, Northeastern University, 1400-410 West Georgia Street, Vancouver, BC V6B 1Z3, Canada
3
Continuing Studies Division, Population Data BC, University of Victoria, B364-3800 Finnerty Road, Victoria, BC V8P 5C2, Canada
This paper is an extended version of our paper published in “ Soltanifar, M. Some Results on the Additivity and Multiplication Order Preserving Properties of Stochastic Orders. In JSM Proceedings; SSC Section; American Statistical Association: Alexandria, VA, USA, 2020; pp. 476–483”.
Submission received: 2 October 2022 / Revised: 8 November 2022 / Accepted: 18 November 2022 / Published: 20 November 2022
(This article belongs to the Special Issue Probability Distributions and Their Applications)

Abstract

:
In this paper, we prove that for a set of ten univariate stochastic orders including the usual order, a univariate stochastic order preserves either both, one or none of additivity and multiplication properties over the vector space of real-valued random variables. Then, classifying participant’s quickness in a mental chronometry trial to “weakly faster” and “strongly faster”, we use the above results for the usual stochastic order to establish necessary and sufficient conditions for a participant to be strongly faster than the other in terms of the fitted Wald, Exponentially modified Wald(ExW), and Exponentially modified Gaussian(ExG) distributional parameters. This research field remains uncultivated for other univariate stochastic orders and in several directions.

1. Introduction

1.1. Univariate Stochastic Orders

In their 1934 book on inequalities, Hardy, Littlewood and Polya introduced the concept of majorization as one of the fundamental building blocks of stochastic orders. Later in 1955, Lehmann introduced the concept of stochastic orders on real valued random variables, [1]. Since then, inspired by their application in many fields there has been a growing literature on these orders specially from 1994. They have been playing a key role in comparison of different probability models in wide range of research areas such as survival analysis, reliability, queuing theory, biology and actuarial science. They serve as an informative comparison criteria between different distributions much more effective than low informative distributional point comparisons of means, medians, variance and interquartile range (IQR). In almost all cases, they have the same fundamental properties of usual order ≤ in real numbers including reflexivity, anti-symmetry, transitivity.

1.2. Motivation

This paper deals with exploring another aspect of stochastic orders including order preserving additive and multiplicative properties. Our investigation originates from natural existence of earlier fundamental properties in both the set of real numbers equipped with usual order and the set of real-valued random variables equipped with one of stochastic orders. Given existence of the mentioned order preserving properties on the set of real numbers equipped with the usual order, there was a missing investigation on their parallel existential conditions for the case of the set of real-valued random variables equipped with a stochastic order.
Our second motivation has roots in theory of reaction times distributions in cognitive psychology. Here, the reaction times have been modelled with a variety of distributions including the single two parametric ones such as Gamma and Lognormal; and; convolutionary three parametric ones such as Ex-Gaussian and Ex-Wald. Despite documentation of stochastic order comparison of the first category of distributions, the stochastic order comparison of the second category is still missing in the literature.
Our third motivation has roots in the comparison of participants’ quickness in mental chronometry trials. While the current used mean or median statistic present some weak evidence on performance comparison between participants, using the entire distribution of experimental data yields to more informative comparison. This work aims to classify participants’ trial performance quickness by presenting two new definitions aiming to put light on some uncultivated areas in the literature.

1.3. Study Outline

This paper is divided into four sections. In the first section, we provide the required definitions and established results for the follow up sections. Then, in the second section, we discuss order preserving additive and multiplicative properties for ten univariate stochastic orders including the usual, the moment, the Laplace transform, the increasing convex, the starshaped, the moment generating function, the convolution, the hazard rate, the likelihood ratio and the mean residual life order. Then, in the third section we present two definitions of the performance quickness in a mental chronometry trial. Then, we present some applications for the Ex-Gaussian, Wald and Ex-Wald distributions in cognitive psychology. We conclude the work with a discussion section on the current results and future directions.

2. Preliminaries

The reader who has studied the concepts of order and stochastic order is well acquainted with the following definitions and results. For an essential account of the mentioned concepts, see [2,3,4]. We begin with some definitions:
Definition 1.
Let P and Q be ordered sets. A map ϕ : P Q is said to be order preserving whenever x y in P implies ϕ ( x ) ϕ ( y ) , in Q .
When P = Q are real valued vector spaces, and for fixed z P the maps ϕ z a d d ( x ) = x + z and ϕ z m u l ( x ) = x z ( 0 < z ) are order preserving, it is said that the order ≤ has additivity and multiplication properties.
It is trivial that for the case P = R equipped with its usual order ≤, the order has additivity and multiplication properties. From now onward, throughout this paper it is assumed that P is the set of all real valued random variables. For the orders related to this P we begin with some of the most well-known ones [1,3,4]:
Definition 2.
Let X and Y be two real-valued random variables with associated CDFs F X , F Y , Laplace transforms L X , L Y , moment generating function M X , M Y , and mean residual life functions m X , m Y , respectively. Then, X is said to be less or equal than Y in the:
(i) 
usual stochastic order denoted by X s t Y , if F X ( t ) F Y ( t ) for all t R .
(ii) 
moment order, denoted by X m Y , if for 0 X , Y we have: E ( X m ) E ( Y m ) for all m N .
(iii) 
Laplace transformation order, denoted by X L t Y , if with assumption 0 X , Y we have: L X ( s ) L Y ( s ) for all s R + .
(iv) 
increasing convex order denoted by X i c x Y , if: E ( g ( X ) ) E ( g ( Y ) ) for all increasing convex functions g.
(v) 
starshaped order denoted by X s s Y , if: E ( g ( X ) ) E ( g ( Y ) ) : for all starshaped functions g : R + R + .
(vi) 
moment generating function denoted by X mgf Y , if with assumption 0 X , Y we have: M X ( s ) M Y ( s ) for all s R + .
(vii) 
convolution order, denoted by X c o n v Y , if for some non-negative independent random variable U of X , Y = s t X + U .
(viii) 
hazard rate order, denoted by X h r Y , if for the hazard function r ( t ) = d F ( t ) d t 1 F ( t ) we have: r X ( t ) r Y ( t ) for all t R .
(ix) 
likelihood ratio order, denoted by X l r Y , if the likelihood ratio function f r a t i o ( t ) = d F X ( t ) d t d F Y ( t ) d t is decreasing for all t R .
(x) 
mean residual life order, denoted by X m r l Y , if for the mean residual function m ( t ) = t + ( 1 F ( u ) ) d u 1 F ( t ) we have: m X ( t ) m Y ( t ) for all t R .
The following corollary presents a useful criteria to compare two distributions in the usual stochastic order:
Corollary 1.
Let X and Y be two real-valued random variables with associated Cumulative Distribution Function (CDF)s F X , and F Y , respectively. Let X s t Y , and consider the likelihood ratio function f r a t i o ( t ) = d F X ( t ) d t d F Y ( t ) d t . Then:
(i) 
lim t + f r a t i o ( t ) 1 ,
(ii) 
lim t f r a t i o ( t ) 1 .
The following example for the case of normal distribution N ( μ , σ 2 ) with mean μ , and the exponential distribution E x p ( τ ) with mean τ is easily verified using Definition 2 and Corollary 1. It also has key applications in the subsequent sections. The other parts relates to key two parametric reaction times distributions widely used in cognitive psychology [3]:
Example 1.
(i) 
N ( μ X , σ X 2 ) s t N ( μ Y , σ Y 2 ) if and only if μ X μ Y and σ X = σ Y .
(ii) 
E x p ( τ X ) s t E x p ( τ Y ) if and only if τ X τ Y .
(iii) 
l o g n o r m a l ( μ X , σ X 2 ) s t l o g n o r m a l ( μ Y , σ Y 2 ) if and only if μ X μ Y and σ X = σ Y .
(iv) 
G a m m a ( α X , β X ) s t G a m m a ( α Y , β Y ) if and only if α X α Y and β X β Y .
(iv) 
W e i b u l l ( α X , β X ) s t W e i b u l l ( α Y , β Y ) if and only if α X α Y and β X = β Y .
It has been mentioned in the literature that usual stochastic order is reflexive, anti-symmetric and transitive [3]. Regarding order preserving maps on P we have [4]:
Theorem 1.
If X o r d Y and ϕ : R R is any increasing function, then ϕ ( X ) o r d ϕ ( Y ) where o r d refers to s t , h r or l r .
In particular, for constant random variable Z 0 , ϕ Z 0 a d d and ϕ Z 0 m u l are order preserving and hence the usual stochastic order is additive and multiplicative in this special case. However, the case in general is still unknown.
An straightforward verification shows that considering the subset P 0 of all constant real-valued random variables of P equipped with one of above four stochastic orders, the order has both of mentioned order preserving properties. This is a parallel result to the case of real numbers R equipped with the usual order ≤. The following lemma will be useful in the proof of the upcoming theorems in the next section, [3,4].
Lemma 1.
Let X , Y be two real valued random variables with associated CDFs F X , F Y , and Laplace transforms L X , L Y , respectively. Then:
(i) 
X i c x Y if and only if: x + ( 1 F X ( t ) ) d t x + ( 1 F Y ( t ) ) d t , for all x R .
(ii) 
X s s Y if and only if: x + t d F X ( t ) x + t d F Y ( t ) for all x R 0 + .
(iii) 
X c o n v Y if and only if for ϕ X , Y = L Y L X we have: ( 1 ) n . ϕ X , Y ( n ) ( s ) 0 for all s R + , n N .
(iv) 
X m g f Y if and only if: Y L t X .
(v) 
X m r l Y with given finite means if and only if g r a t i o ( t ) = t + ( 1 F X ( u ) ) d u t + ( 1 F Y ( u ) ) d u is decreasing.
We conclude this section with a remark on the independency of involved random variables:
Remark 1.
Considering any pair of real numbers x 0 , y 0 as constant random variables X = x 0 and Y = y 0 , it is trivial that any constant random variable Z = z 0 is independent from each of them. Hence, it is natural to maintain this independency assumption for inferential results for the case of non-constant random variables.

3. Order Preserving Properties of Univariate Stochastic Orders

This section deals with general properties of univariate stochastic order. Throughout this section, we assume the given random variable Z is independent from X and Y. First of all, for the case of reflexivity, anti-symmetry and transitivity, it is easy to show that all of these orders are preserving these properties. Second, we discuss the additivity and multiplication properties. Then, we present an evidence of the necessity of the independence of X , Z ( Y , Z ) and the positivity of the random variable Z in the preservation of the multiplication conditions.
Theorem 2.
A univariate stochastic order o r d may preserve either both additivity and multiplication, or one of them, or none of them.
Proof. 
Indeed, we prove the results based on the following Table 1 and Table 2:
The summary of proofs in the Table 1 are as follows: First, to prove the case for the usual stochastic order s t , it is sufficient to use the convolutionary integral representation of the involved CDFs ( F Y + Z , F X + Z , F Y Z , F X Z )in terms of component CDFs( F X , F Y , F Z ). Second, the proof for the case of moment order m , is straightforward using the Definition 2 (ii). Third, the proof for the case of Laplace transformation order L t , is straightforward using the Definition 2 (iii). Fourth, the proof for the case of increasing convex order i c x , is done using repetitive applications of the Lemma 1 and the Fubini’s theorem. Fifth, the proof for the case of starshaped order s s is similar to that of increasing convex order i c x . Sixth, the result for the case of moment generating function order m g f is a direct consequence from the additivity for Laplace transformation order and Lemma 1. Seventh, the additivity result for the case of convolution order c o n v follows from two applications of Lemma 1 and given condition.
The summary of counterexamples supporting results for rows (vii–x) in the Table 1 are as follows in Table 2. Note that some of their special cases are established. Some examples include additivity for the hazard rate order h r (when Z has the increasing failure rate (IFR) [4] (Lemma 1.B.3)); additivity for the likelihood ratio order l r (when X , Y , Z all have logconcave densities, [4] (Theorem.1.C.9)); and, additivity for the mean residual life order m r l (when Z has IFR, [3] (Theorem.2.4.22)).
The computations for the above counterexamples are presented in the supplementary materials. This completes the proof. □
Remark 2.
In Theorem 2 the case of additivity and multipliciation for the usual stochastic order and the increasing convex order can be proved using [4] Theorem 1.A.3(b) and Theorem 4.A.15, respectively with m = 2 , X 1 = X , X 2 = Z , Y 1 = Y , Y 2 = Z , and consideration of two bi-variate increasing functions ψ 1 ( u , v ) = u + v (for additivity) and ψ 2 ( u , v ) = u v (for multiplication).
Remark 3.
In the Theorem 2, the assumption of the independence is necessary for preserving the additivity, the multiplication. Also, the assumption of positivity of the random variable Z is necessary for preserving the multiplication. To see this, first, for the additivity case take X = d N ( 0 , 1 2 ) , Y = d N ( 1 , 1 2 ) and Z = X with given usual stochastic order yielding X + Z s t Y + Z . Next, for the multiplicity case, take X = d l o g N ( 0 , 1 2 ) , Y = d l o g N ( 1 , 1 2 ) and Z = X 1 with given usual stochastic order yielding X Z s t Y Z . Finally, for the positivity of random variable Z , take X = d N ( 0 , 1 ) , Y = d N ( 1 , 1 ) and Z = d 0.5 ( δ { 1 } + δ { + 1 } ) with given usual stochastic order implying X Z s t Y Z . The verifications are all straightforward.
We finish this section with a brief note on the applications of Theorem 2. One of its key applications is when one aims to compare two given single component convolutionary distributions or two given two-component mixture distributions. In both after-mentioned scenarios, Theorem 2 presents sufficient conditions for the comparisons. In case of parametric distributions, these sufficient conditions are explained in terms of involved parameters as we will see in the next section.

4. Applications in Cognitive Psychology

This section presents some applications of the Theorem 2 in the area of cognitive psychology. In mental chronometry trials, a participant is considered faster than the other when the point estimation (e.g., mean, median) of their trial reaction times is statistically less than the other. Given that most reaction times distributions are skewed, the mean statistics presents poor measure of central tendency for these distributions and the median statistics presents somewhat biased estimations [5], it is natural to shift the focus on the participant’s entire distribution of the trial reaction times. To distinguish these perspectives, we present two definitions:
Definition 3.
A participant is “weakly faster” than the other in a mental chronometry trial when the former’s reaction times point statistics (e.g., mean, median) is significantly smaller than the later one.
Definition 4.
A participant is “strongly faster” than the other in a mental chronometry trial when in a given stochastic order o r d the former’s reaction times distribution is smaller than the later one.
Remark 4.
It is trivial that for the case of usual stochastic order, the Definition 4 yields the Definition 3. However, its converse statement is false. As a counterexample, let X = d l o g n o r m a l ( 0 , 2 ) and Y = d l o g n o r m a l ( 1 , 4 ) . Then, E ( X ) = e < e 3 = E ( Y ) , but, by Example 1, X s t Y . This yields the Venn diagram shown in Figure 1:
This work focuses on the concept of “strongly faster” presented in the Definition 4. Referring to the results in the Table 1 in the proof of the Theorem 2, from now on we assume the underlying stochastic order for comparisons is the usual stochastic order s t . Furthermore, only single component distributions as in [6] are considered requiring the preservation of only additivity (The mixture distributions as in [7] require preservation of both additivity and multiplication). In particular, when the distributions of interest are parametric, describing their stochastic order in terms of their associated parameters is plausible. In this section we consider two of the most prominent single component convolutionary reactions times distributions: The Ex-Gaussian distribution and the the Ex-Wald distribution.

4.1. The Exponentially Modified Gaussian (ExG) Distribution

Response inhibition in human brain has two main components: reactive inhibition and proactive inhibition. Various distributional models including convolutionary distributions and mixture distributions have been proposed to describe these components [6,7,8]. The first convolutionary distribution playing such key role is the well-known exponentially modified Gaussian(ExG) distribution [9]. This distribution is defined by E x G ( μ , σ , τ ) = d N ( μ , σ 2 ) + E x p ( τ ) and its mean and variance are given by μ + τ and σ 2 + τ 2 , respectively. Its density function and cumulative function are respectively given by:
f E x G ( t ; μ , σ , τ ) = 1 τ exp ( t μ τ + σ 2 2 τ 2 ) × Φ ( t μ σ σ τ ) : t R , σ , τ > 0
F E x G ( t ; μ , σ , τ ) = Φ ( t μ σ ) exp ( t μ τ + σ 2 2 τ 2 ) × Φ ( t μ σ σ τ ) ,
where Φ denotes the CDF of the standard normal distribution.
In its single distribution format [6] and the two components mixture format [7] it is applied to describe the brain reactive inhibition. Furthermore, its differences of two components known as the asymmetric Laplace Gaussian(ALG) distribution [8,10,11] is applied to describe the brain proactive inhibition. Given ExG extensive usage to describe human brain reaction times, we are interested to compare these distributions in terms of their parameters. This characterizes which experimental participant has faster inhibition than the other in terms of the fitted distributional parameters adding more insights to the underlying processes [12,13]:
Theorem 3.
Given two parametric distributions U = d E x G ( μ U , σ U , τ U ) and V = d E x G ( μ V , σ V , τ V ) , in which μ U , μ V R and σ U , σ V , τ U , τ V R + . Then:
(i) 
U s t V whenever μ U μ V , σ U = σ V , and τ U τ V ,
(ii) 
U s t V only if μ U μ V + ϵ ( ϵ = τ V τ U ) , σ U 1 σ V 1 , and τ U τ V .
Proof. 
To prove part (i), by an application of Example 1, two applications of Theorem 2, and considering the transitivity of the usual stochastic order it follows that:
U = d E x G ( μ U , σ U , τ U ) = N ( μ U , σ U 2 ) + E x p ( τ U ) s t N ( μ V , σ V 2 ) + E x p ( τ U ) s t N ( μ V , σ V 2 ) + E x p ( τ V ) = d E x G ( μ V , σ V , τ V ) = d V .
To prove part (ii) first of all, consider the likelihood ratio function:
f r a t i o ( t ) = f E x G ( t ; μ U , σ U , τ U ) f E x G ( t ; μ V , σ V , τ V ) = 1 τ U exp ( t μ U τ U + σ U 2 2 τ U 2 ) 1 τ V exp ( t μ V τ V + σ V 2 2 τ V 2 ) × Φ ( t μ U σ U σ U τ U ) Φ ( t μ V σ V σ V τ V ) , = e . Φ ( a 1 t + b 1 ) exp ( c t + d ) Φ ( a 2 t + b 2 ) for all t R ,
where in which e = τ V τ U 1 , a 1 = σ U 1 > 0 , a 2 = σ V 1 > 0 , b 1 = ( μ U σ U 1 + σ U τ U 1 ) , b 2 = ( μ V σ V 1 + σ V τ V 1 ) ,   c = ( τ V 1 τ U 1 ) and d = ( ( μ U τ U μ V τ V ) + ( σ U 2 2 τ U 2 σ V 2 2 τ V 2 ) ) . Now, by Corollary 1 (i) in which lim t + f r a t i o ( t ) 1 , we have c 0 or equivalently τ U τ V .
Second, applying L’Hopital’s rule(LHR), it follows:
lim t f r a t i o ( t ) = lim t ( e . Φ ( a 1 t + b 1 ) exp ( c t + d ) Φ ( a 2 t + b 2 ) ) = L H R lim t ( a 1 e exp ( ( a 1 t + b 1 ) 2 / 2 ( c t + d ) ) 2 π c Φ ( a 2 t + b 2 ) + a 2 exp ( ( a 2 t + b 2 ) 2 / 2 ) ) = L H R lim t ( a 1 a 2 e ( a 1 ( a 1 t + b 1 ) + c a 2 ( a 2 t + b 2 ) c ) ( exp ( ( a 1 t + b 1 ) 2 / 2 ( c t + d ) ) exp ( ( a 2 t + b 2 ) 2 / 2 ) ) ) = ( a 1 a 2 ) 3 e lim t exp ( ( a 2 2 a 1 2 2 ) t 2 + ( a 2 b 2 a 1 b 1 c ) t + b 2 2 b 1 2 2 d 2 ) .
Again, similar to the previous case, by Corollary 1 (ii) in which lim t f r a t i o ( t ) 1 , we have a 2 2 a 1 2 2 0 or equivalently σ V 1 σ U 1 . Third, by definition, μ U + τ U = E ( U ) E ( V ) = μ V + τ V , yielding the plausible statement. □
Remark 5.
Theorem 3 (ii) provides a necessary but insufficient condition. To see this, we present two counterexamples:
Counterexample 1.
ϵ = 1 > 0 : Let U = d E x G ( 0 , 1 , 1 ) and V = d E x G ( 0.5 , 1 , 2 ) . Then, given F E x G ( 1 ; 0 , 1 , 1 ) = 0.0566962 < 0.0776955 = F E x G ( 1 ; 0.5 , 1 , 2 ) (See supplementary materials) we have U s t V .
Counterexample 2.
ϵ = 0 : Let U = d E x G ( 0 , 4 , 1 ) and V = d E x G ( 1 , 1 , 1 ) . Then, given F E x G ( 4 ; 0 , 4 , 1 ) = 0.7676428 < 0.9184325 = F E x G ( 4 ; 1 , 1 , 1 ) (See supplementary materials) we have U s t V .

4.2. The Exponentially Modified Wald (ExW) Distribution

A key characteristics of the ExG distribution is its increasing hazard function. However, in many applications, the hazard function of the reaction times are peaked. This problem encouraged researchers to consider other candidate distributions with peaked hazard functions including the Wald and the exponentially modified Wald (ExW) distributions. These distribution have applications in mental health [14,15] and have been introduced in various parametric forms [14,15,16,17,18,19]. The ExW distribution is defined by E x W ( μ , σ , τ ) = d W a l d ( μ , σ 2 ) + E x p ( τ ) and its mean and variance are given by μ + τ and μ 3 σ 2 + τ 2 , respectively. Here, the Wald or Inverse Gaussian(IG) component has the mean μ and the dispersion parameter σ 2 (or shape parameter σ 2 ). The density function and CDF of the Wald and ExW distributions are given by:
f W ( t ; μ , σ ) = 1 2 π σ t 3 2 exp ( ( t μ ) 2 2 σ 2 μ 2 t ) : t R 0 + , μ , σ > 0 ,
F W ( t ; μ , σ ) = Φ ( t μ σ μ t ) + exp ( 2 μ σ 2 ) Φ ( t μ σ μ t ) ,
f E x W ( t ; μ , σ , τ ) = 1 τ exp ( t τ + 1 μ k μ σ 2 ) × F W ( t ; k , σ ) : k = τ 2 μ 2 σ 2 μ 2 τ > 0 ,
F E x W ( t ; μ , σ , τ ) = F W ( t ; μ , σ ) exp ( t τ + 1 μ k μ σ 2 ) × F W ( t ; k , σ ) ,
where as before Φ denotes the CDF of the standard normal distribution. To discuss the usual stochastic order relationship between ExW distributions, we need the plausible relationships for its components as in the case of ExG distribution. We first establish the relationship between the usual stochastic order between two Wald random variables and their associated parameters similar to the two parametric reaction time distributions presented in Example 1 (iii–iv):
Lemma 2.
W a l d ( μ X , σ X 2 ) s t W a l d ( μ Y , σ Y 2 ) if and only if μ X μ Y 1 σ X 1 σ Y 1 .
Proof. 
To prove the necessity, consider the likelihood ratio function:
f r a t i o ( t ) = f W ( t ; μ X , σ X ) f W ( t ; μ Y , σ Y ) = 1 2 π σ X t 3 2 exp ( ( t μ X ) 2 2 σ X 2 μ X 2 t ) 1 2 π σ Y t 3 2 exp ( ( t μ Y ) 2 2 σ Y 2 μ Y 2 t ) = d . exp ( a t + b + c t 1 ) ,
where in which d = σ Y σ X , a = 1 2 σ Y 2 μ Y 2 1 2 σ X 2 μ X 2 , b = ( 1 σ Y 2 μ Y 1 σ X 2 μ X ) and c = 1 2 σ Y 2 1 2 σ X 2 . Now, again by Corollary 1 in which lim t + f r a t i o ( t ) 1 , it follows a 0 or equivalently:
μ X μ Y 1 σ X 1 σ Y .
Next, another application of Corollary 1 in which lim t 0 + f r a t i o ( t ) 1 , yields c 0 or equivalently:
σ X 1 σ Y 1 .
Consequently, by combining the inequalities (11) and (12) the assertion follows.
To prove the sufficiency, we note that given the condition we have:
d d t log ( f r a t i o ( t ) ) = a c t 2 0 , for all t R 0 + .
Hence, f r a t i o is decreasing function on R 0 + and consequently, by Definition 2 (viii) X l r Y . But, the likelihood ratio stochastic order yields the usual stochastic order [4] (Theorem 1.C.1, page 43). This completes the proof. □
Remark 6.
A simple modification in the proof of Lemma 2 and the usage of Definition 4 (ix) shows that the similar statement for the case of likelihood ratio stochastic order l r holds as well.
Equipped with Theorem 2 and Lemma 2, we are now able to present the twin of Theorem 3 for the case of ExW distribution:
Theorem 4.
Given two parametric distributions U = d E x W ( μ U , σ U , τ U ) and V = d E x W ( μ V , σ V , τ V ) , in which μ U , μ V , σ U , σ V , τ U , τ V , k U , k V R + . Then:
(i) 
U s t V whenever μ U μ V 1 σ U 1 σ V 1 and τ U τ V ,
(ii) 
U s t V only if μ U μ V + ϵ ( ϵ = τ V τ U ) , σ U 1 σ V 1 , and τ U τ V .
Proof. 
We repeat the process presented in the proof of Theorem 3 (for the case of ExG distribution) with some modifications. To prove part (i), by an application of Lemma 2, two applications of Theorem 2, and considering the transitivity of the usual stochastic order it follows that:
U = d E x W ( μ U , σ U , τ U ) = W a l d ( μ U , σ U 2 ) + E x p ( τ U ) s t W a l d ( μ V , σ V 2 ) + E x p ( τ U ) s t W a l d ( μ V , σ V 2 ) + E x p ( τ V ) = d E x W ( μ V , σ V , τ V ) = d V .
To prove part (ii), first of all, consider the likelihood ratio function:
f r a t i o ( t ) = f E x W ( t ; μ U , σ U , τ U ) f E x W ( t ; μ V , σ V , τ V ) = 1 τ U exp ( t τ U + 1 μ U k U μ U σ U 2 ) × F W ( t ; k U , σ U ) 1 τ V exp ( t τ V + 1 μ V k V μ V σ V 2 ) × F W ( t ; k V , σ V ) = g . F W ( t ; k U , σ U ) exp ( e t + f ) F W ( t ; k V , σ V ) for all t R ,
where in which g = τ V τ U 1 > 0 , e = ( τ V 1 τ U 1 ) , and f = 1 μ V k V μ V σ V 2 1 μ U k U μ U σ U 2 . Now, by Corollary 1 (i) in which lim t + f r a t i o ( t ) 1 , we have e 0 or equivalently τ U τ V .
Second, applying L’Hopital’s rule(LHR), it follows:
lim t 0 + f r a t i o ( t ) = lim t 0 + g . F W ( t ; k U , σ U ) exp ( e t + f ) F W ( t ; k V , σ V ) = g exp ( f ) lim t 0 + F W ( t ; k U , σ U ) F W ( t ; k V , σ V ) = L H R g exp ( f ) lim t 0 + f W ( t ; k U , σ U ) f W ( t ; k V , σ V ) = g exp ( f ) lim t 0 + d exp ( a t + b + c t 1 ) ,
where in which d = σ V σ U > 0 , a = 1 2 σ V 2 k V 2 1 2 σ U 2 k U 2 , b = ( 1 σ V 2 k V 1 σ U 2 k U ) and c = 1 2 σ V 2 1 2 σ U 2 . A final application of Corollary 1 in which lim t 0 + f r a t i o ( t ) 1 , yields c 0 or equivalently:
σ U 1 σ V 1 .
The proof of the third part is as in Theorem 3. □
Remark 7.
Theorem 4 (ii) provides a necessary but insufficient condition. To see this, we present two counterexamples:
Counterexample 3.
ϵ = 0.05 > 0 : Let U = d E x W ( 0.10 , 0.10 , 0.00025 ) and V = d E x W ( 0.05 , 0.10 , 0.05025 ) . Then, given F E x W ( 0.10 ; 0.10 , 0.10 , 0.00025 ) = 0.5 < 1.0 = F E x W ( 0.10 ; 0.05 , 0.10 , 0.00025 ) (See Supplementary Materials) we have U s t V .
Counterexample 4.
ϵ = 0 : Let U = d E x W ( 0.10 , 0.10 , 0.00025 ) and V = d E x W ( 0.10 , 0.05, 0.00025). Then, given F E x W ( 0.1025 ; 0.10 , 0.10 , 0.00025 ) = 0.782560 < 0.940825 = F E x W (0.1025; 0.10,0.05, 0.00025)(See Supplementary Materials) we have U s t V .

5. Discussion

5.1. Summary & Contributions

This work presented a report on fundamental order preserving properties of addition and multiplication for the case of real-valued univariate random variables. It generalized the case from the usual order on the real numbers to the usual stochastic order maintaining the assumptions of independence of involved random variables ( X , Z ) and ( Y , Z ) and the positivity of the random variable Z . However, investigation over other types of univariate stochastic orders showed that preservation of these fundamental properties varied by the type of considered order. Hence, to compare the convolutionary reaction times distributions such as ExG and ExW in terms of their involved parameters, the researchers need to ensure the preservation of their addition and multiplication under the assumed stochastic order o r d . We established these conditions for the most promising candidate -the usual stochastic order s t —and investigated the comparison of convolutionary reaction time distributions ExG and ExW.
We discuss the similarity and differences in preservation of orders in terms of parameters of fitted ExG and ExW distributions presented in Section 4. First of all, in both cases, the sufficient condition is strictly stronger than the necessary condition. Furthermore, given the Counterexamples 1–4 the set of ordered distributions is proper subset of the distributions with the associated necessary conditions. On the other hand, the sufficient condition for the case of ExW distribution has one extra component (4 vs. 3) compared to the ExG distribution. Also, for ExW case the condition for the μ parameter is manifested through the division rather than the difference in the ExG case. Figure 2 presents the relative position of the necessary conditions, preserved usual stochastic orders and the sufficient conditions in both Theorems 3 and 4.
We finish this section with a key application of the presented results in Theorems 3 and 4 for clinicians. While participant’s performance have been compared in terms of the Definition 3 across a wide spectrum of clinical conditions such as Attention Deficit Hyperactivity Disorder(ADHD), Autism Spectrum Disorder (ASD), Healthy Controls(HL), and Obsessive Compulsive Disorder(OCD) [20,21,22], there is still missing research to compare them in terms of the Definition 4. Given the stronger nature of performance presented in later definition, such research may present more information on the participant’s performance. Table 3 presents a variety of two-parametric and three-parametric distributional options for the researchers:

5.2. Limitations & Future Work

The limitations of this work are clear and each one on its own creates ground for future work. Eight of them are as follows: First, there are other types of univariate stochastic orders that this study did not cover their preservation properties. Some of them included the harmonic mean residual life order, Lorenz order, dilation order, dispersive order, excessive wealth order, peakedness order, pth order, star order, superadditive order, factorial moment order, and total time on test order, [3,4]. Second, the case of order preservation under additivity and multiplication for the multivatiate random variables is still unknown. Third, the application in psychology was limited to the case convolutionary ExG with increasing hazard function and the case for convolutionary ExW distribution [12,16,17,18] with peaked hazard function. However, the case for the ALG distribution is still unknown. Fourth, we discuss the application in cognitive psychology for only the usual stochastic order while the results of Theorems 3 and 4 remain unclear for other stochastic orders such as the moment order, the Laplace transformation order, the Increasing convex order, the Starshaped order, the moment generating function order, and the convolution order. Fifth, while we interpreted the case for usual stochastic order in terms of being strongly faster, the interpretations for other stochastic orders remains unknown. Sixth, there is need of clarification of relationship between these parameters for two participants and the underlying brain processes. Seventh, to establish the necessary conditions presented in Theorems 3 and 4 we used Corollary 1 while we could consider the case in Theorem 1.A.12 [1]. This direction on its own is a single stand alone research. Finally, we presented only one application of the preservation of the orders (as in the case of usual stochastic order) and it is plausible to investigate possibility of application in other fields.

5.3. Conclusions

This work has discussed the order preservation under summation and multiplication for variety of univariate stochastic orders. For the case of usual stochastic order, it used its preserving status to discuss the necessary and sufficient parametric conditions for the convolutionary ExG and ExW distributions. This finding presents criteria for the cognitive psychologists to compare participants’ performance in terms of their fitted distributional parameters.

Supplementary Materials

The following supporting information can be downloaded at: https://0-www-mdpi-com.brum.beds.ac.uk/article/10.3390/math10224362/s1, R statistical software code [23] for computing the counterexamples presented in the work is attached in the Supplementary Materials.

Funding

This research received no external funding.

Institutional Review Board Statement

Not applicable.

Informed Consent Statement

Not applicable.

Data Availability Statement

Not applicable.

Acknowledgments

The author is grateful to three journal reviewers for their constructive comments and suggestions on the first draft of the manuscript.

Conflicts of Interest

The author declares no conflict of interest.

Abbreviations

The following abbreviations are used in this manuscript:
ADHDAttention Deficit Hyperactivity Disorder
ALAsymmetric Laplace distribution
ALGAsymmetric Laplace Gaussian distribution
ASDAutism Spectrum Disorder
CDFCumulative Distribution Function
ExGExponentially modified Gaussian distribution
ExWExponentially modified Wald distribution
HLHealthy Control
IFRIncreasing Failure Rate
IGInverse Gaussian distribution
IQRInterquartile Range
LHRL’Hopital’s rule
OCDObsessive Compulsive Disorder

References

  1. Mosler, K.; Scarsini, M.; Dyckerhoff, R.; Holz, H. Stochastic Orders and Applications: A Classified Bibliography (Lecture Notes in Economics and Mathematical Systems, 401), 1st ed.; Springer: New York, NY, USA, 1993. [Google Scholar]
  2. Davey, B.A.; Priestly, H.A. Introduction to Lattices and Orders, 2nd ed; Camridge University Press: Cambridge, UK, 2002; p. 2, 23. [Google Scholar]
  3. Belzunce, F.; Martinez-Riquelme, C.; Mulero, J. An Introduction to Stochastic Orders; Elsevier Ltd.: Amsterdam, The Netherlands, 2016; pp. 29–30, 58, 63, 102. [Google Scholar]
  4. Shaked, M.; Shantikumar, J.G. Stochastic Orders; Springer: Berlin/Heidelberg, Germany, 2010; pp. 5–6, 18, 71. [Google Scholar]
  5. Rousselet, G.A.; Wilcox, R.R. Reaction Times and Other Skewed Distributions: Problems with the Mean and Median. Meta Psychol. 2020, 4, 1630. [Google Scholar] [CrossRef]
  6. Matzke, D.; Dolan, C.V.; Logan, G.D.; Brown, S.D.; Wagenmakers, E.J. Bayesian Parametric Estimation of Stop signal Reaction Time Distributions. J. Exp. Psychol. Gen. 2013, 142, 1047–1073. [Google Scholar] [CrossRef] [PubMed]
  7. Soltanifar, M.; Escobar, M.; Dupuis, A.; Schachar, R. A Bayesian Mixture Modelling of Stop Signal Reaction Time Distributions: The Second Contextual Solution for the Problem of Aftereffects of Inhibition on SSRT Estimations. Brain Sci. 2021, 11, 1102. [Google Scholar] [CrossRef] [PubMed]
  8. Soltanifar, M.; Escobar, M.; Dupuis, A.; Chevrier, A.; Schachar, R. The Asymmetric Laplace Gaussian (ALG) Distribution as the Descriptive Model for the Internal Proactive Inhibition in the Standard Stop Signal Task. Brain Sci. 2022, 12, 730. [Google Scholar] [CrossRef] [PubMed]
  9. Heatcote, A. RTSYS: A DOS Application for the Analysis of Reaction Times Data. Behav. Res. Methods Instrum. Comput. 1996, 28, 427–445. [Google Scholar] [CrossRef]
  10. Reed, W. The Normal-Laplace distribution and its relatives. In Advances in Distribution Theory, Order Statistics, and Inference (Statistics for Industry and Technology); Balakrishnan, N., Castillo, E., Sarabia Algeria, J.M., Eds.; Birkhäuser: Boston, MA, USA, 2006; pp. 61–73. [Google Scholar]
  11. Amini, Z.; Rabbani, H. Letter to the editor: Correction to “The Normal-Laplace distribution and its relatives”. Commun. Stat. Theory Methods 2017, 46, 2076–2078. [Google Scholar] [CrossRef]
  12. Rieger, T.; Miller, J. Are model parameters linked to processing stages? An empirical investigation for the ex-Gaussian, ex-Wald, and EZ diffusion models. Psychol. Res. 2019, 84, 1683–1699. [Google Scholar] [CrossRef] [PubMed]
  13. Fitousi, D. Linking the Ex-Gaussian parameters to cognitive stages: Insights from the Linear Ballistic Accumulator(LBA) model. Quant. Methods Psychol. 2020, 16, 91–106. [Google Scholar] [CrossRef]
  14. Seshadri, V. The Inverse Gaussian Distribution: Statistical Theory and Applications (Lecture Notes in Statistics, 137); Springer: New York, NY, USA, 1999; p. 230. [Google Scholar]
  15. Giner, G.; Smyth, G. statmod: Probability Calculations for the Inverse Gaussian Distribution. R J. 2016, 8, 339. [Google Scholar] [CrossRef]
  16. Schwarz, W. The ex-Wald distribution as a descriptive model of response times. Behav. Res. Methods Instrum. Comput. 2001, 33, 457–469. [Google Scholar] [CrossRef]
  17. Heathcote, A. Fitting Wald and ex-Wald distributions to response time data: An example using functions for the S-PLUS package. Behav. Res. Methods Instrum. Comput. 2004, 36, 678–694. [Google Scholar] [CrossRef] [Green Version]
  18. Del Prado Martin, F.M. A Theory of Reaction Time Distributions. cogprints6326. 2009. Available online: http://cogprints.org/6326 (accessed on 25 September 2022).
  19. Palmer, E.M.; Horowitz, T.S.; Torralba, A.; Wolfe, J.M. What are the shapes of response time distributions in visual search? J. Exp. Psychol. Hum. Percept. Perform. 2011, 37, 58–71. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  20. Vloet, T.D.; Marx, I.; Kahraman-Lanzerath, B.; Zepf, F.D.; Herpertz-Dahlmann, B.; Konrad, K. Neurocognitive Performance in Children with ADHD and OCD. J. Abnorm. Child. Psychol. 2010, 38, 961–969. [Google Scholar] [CrossRef] [PubMed]
  21. Rubia, K.; Cubillo, A.; Woolley, J.; Brammer, M.J.; Smith, A. Disorder-specific dysfunctions in patients with attention-deficit/hyperactivity disorder compared to patients with obsessive-compulsive disorder during interference inhibition and attention allocation. Hum. Brain Mapp. 2011, 32, 601–611. [Google Scholar] [CrossRef] [PubMed]
  22. Schachar, R.J.; Dupuis, A.; Anagnostou, E.; Georgiades, S.; Soreni, N.; Arnold, P.D.; Burton, C.L.; Crosbie, J. Obsessive-compulsive disorder in children and youth: Neurocognitive function in clinic and community samples. J. Child Psychol. Psychiatr. 2022, 63, 881–889. [Google Scholar] [CrossRef] [PubMed]
  23. R Core Team. R: A Language and Environment for Statistical Computing (R Version 4.2.0); R Foundation for Statistical Computing: Vienna, Austria, 2022. [Google Scholar]
Figure 1. The Venn diagram for the concepts of “strongly faster“ and the “weakly faster”.
Figure 1. The Venn diagram for the concepts of “strongly faster“ and the “weakly faster”.
Mathematics 10 04362 g001
Figure 2. The Venn diagram for the association between usual stochastic relationship and the parameters: (a) ExG distribution; (b) ExW distribution.
Figure 2. The Venn diagram for the association between usual stochastic relationship and the parameters: (a) ExG distribution; (b) ExW distribution.
Mathematics 10 04362 g002
Table 1. A Summary of order preserving properties of ten univariate stochastic orders.
Table 1. A Summary of order preserving properties of ten univariate stochastic orders.
Order Preserving Property
#Order TypeAdditionMultiplication
iUsual s t
iiMoment m
iiiLaplace transformation L t
ivIncreasing Convex i c x
vStarshaped s s
viMoment generating function m g f
viiConvolution c o n v X
viiiHazard Rate h r XX
ixLikelihood ratio l r XX
xMean residual life m r l XX
Table 2. A Summary of counterexamples of additivity and multiplication order preserving in the univariate stochastic orders.
Table 2. A Summary of counterexamples of additivity and multiplication order preserving in the univariate stochastic orders.
#Order TypeAddition
X + Z ord Y + Z
Multiplication
XZ ord YZ
viiConvolution c o n v NATake X = d E x p ( 1 ) , Y = d E x p ( 0.5 ) , and Z = d B ( 0.5 ) . Consider ϕ X Z , Y Z sign change and use Lemma 1.
viiiHazard Rate h r Take X = d E x p ( 2.5 ) , Y = d   E x p ( 1.5 ) , and Z = d l o g   l o g i s t i c ( s h a p e = 3 , s c a l e = 1 ) . Here: r X + Z ( 5 ) = 0.6887492 < 0.8289970 = r Y + Z ( 5 ) . Take X = d e x p ( E x p ( 2.5 ) ) ,   Y = d e x p ( E x p ( 1.5 ) ) , and Z = d e x p ( l o g l o g i s t i c   ( s h a p e = 3 , s c a l e = 1 ) ) . Apply Theorem 1 for ϕ = log .
ixLikelihood ratio l r Take X = d N ( 0 , 1 ) ,   Y = d N ( 1 , 1 ) , and Z = d C a u c h y ( l o c a t i o n = 0 ,   s c a l e = 1 ) . Then, consider ( t i ) i = 1 3 = ( 1 , 3 , 7 ) , and ( f r a t i o ( t i ) ) i = 1 3 = ( 0.799634 ,   0.4814513 , 0.7214805 ) . Take X = d e x p ( N ( 0 , 1 ) ) ,   Y = d e x p ( N ( 1 , 1 ) ) , and Z = d e x p ( C a u c h y   ( l o c a t i o n = 0 , s c a l e = 1 ) ) . Apply Theorem 1 for ϕ = log .
xMean residual life m r l Take X = d N ( 0 , 1 ) ,   Y = d N ( 1 , 2 ) , and Z = d l o g n o r m a l ( m e a n l o g = 0.25, s d l o g = 1 ) . Then, consider ( t i ) i = 1 3   = ( 1 , 3 , 5 ) , and ( g r a t i o ( t i ) ) i = 1 3 = ( 0.5973625 ,   0.5301898 , 0.5913812 ) . Take X = d N ( 0 , 1 ) ,   Y = d N ( 1 , 2 ) , and Z = d e x p ( l o g n o r m a l ( m e a n l o g = 0.25, s d l o g = 1 ) ) . Then, consider ( t i ) i = 1 3   = ( 10 , 2 , 30 ) , and ( g r a t i o ( t i ) ) i = 1 3 = ( 0.5632457 ,   0.5092787 , 0.5181358 ) .
Table 3. A summary of quickness status in terms of parameters of key two parametric and three parametric reaction time distributions.
Table 3. A summary of quickness status in terms of parameters of key two parametric and three parametric reaction time distributions.
#Distributions X , Y Weakly Faster E ( X ) E ( Y ) Strongly Faster X st Y
The Sufficient Condition
The Necessary Condition
i l o g n o r m a l ( μ , σ 2 ) exp ( μ X + σ X 2 2 ) exp ( μ Y + σ Y 2 2 ) μ X μ Y and σ X = σ Y . μ X μ Y and σ X = σ Y .
ii G a m m a ( α , β ) α X β X α Y β Y α X α Y and β X β Y . α X α Y and β X β Y .
iii W e i b u l l ( α , β ) α X Γ ( 1 + β X 1 ) α Y Γ ( 1 + β Y 1 ) α X α Y and β X = β Y . α X α Y and β X = β Y .
iv W a l d ( μ , σ 2 ) μ X μ Y μ X μ Y 1 σ X 1 σ Y 1 . μ X μ Y 1 σ X 1 σ Y 1 .
v E x G ( μ , σ , τ ) μ X + τ X μ Y + τ Y μ X μ Y 0 , σ X 1 σ Y = 1 , and τ X τ Y 1 1 . μ X μ Y ϵ , σ X 1 σ Y 1 , and τ X τ Y 1 1 .
vi E x W ( μ , σ , τ ) μ X + τ X μ Y + τ Y μ X μ Y 1 σ X 1 σ Y , σ X 1 σ Y 1 , and τ X τ Y 1 1 . μ X μ Y 1 1 + ϵ , σ X 1 σ Y 1 , and τ X τ Y 1 1 .
Publisher’s Note: MDPI stays neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Share and Cite

MDPI and ACS Style

Soltanifar, M. A Look at the Primary Order Preserving Properties of Stochastic Orders: Theorems, Counterexamples and Applications in Cognitive Psychology. Mathematics 2022, 10, 4362. https://0-doi-org.brum.beds.ac.uk/10.3390/math10224362

AMA Style

Soltanifar M. A Look at the Primary Order Preserving Properties of Stochastic Orders: Theorems, Counterexamples and Applications in Cognitive Psychology. Mathematics. 2022; 10(22):4362. https://0-doi-org.brum.beds.ac.uk/10.3390/math10224362

Chicago/Turabian Style

Soltanifar, Mohsen. 2022. "A Look at the Primary Order Preserving Properties of Stochastic Orders: Theorems, Counterexamples and Applications in Cognitive Psychology" Mathematics 10, no. 22: 4362. https://0-doi-org.brum.beds.ac.uk/10.3390/math10224362

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop