Next Article in Journal
Predictor Analysis in Group Decision Making
Next Article in Special Issue
Cumulative Median Estimation for Sufficient Dimension Reduction
Previous Article in Journal
Acknowledgment to Reviewers of Stats in 2020
Previous Article in Special Issue
Nonparametric Limits of Agreement for Small to Moderate Sample Sizes: A Simulation Study
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

Improving the Efficiency of Robust Estimators for the Generalized Linear Model

1
Nice Computing SA, 1052 Le Mont-sur-Lausanne, Switzerland
2
Faculty of Biology and Medicine, University of Lausanne, 1015 Lausanne, Switzerland
Submission received: 2 December 2020 / Revised: 22 January 2021 / Accepted: 25 January 2021 / Published: 4 February 2021
(This article belongs to the Special Issue Robust Statistics in Action)

Abstract

:
The distance constrained maximum likelihood procedure (DCML) optimally combines a robust estimator with the maximum likelihood estimator with the purpose of improving its small sample efficiency while preserving a good robustness level. It has been published for the linear model and is now extended to the GLM. Monte Carlo experiments are used to explore the performance of this extension in the Poisson regression case. Several published robust candidates for the DCML are compared; the modified conditional maximum likelihood estimator starting with a very robust minimum density power divergence estimator is selected as the best candidate. It is shown empirically that the DCML remarkably improves its small sample efficiency without loss of robustness. An example using real hospital length of stay data fitted by the negative binomial regression model is discussed.

1. Introduction

For a long time, early robust parametric procedures were unable to combine a high level of outlier-resistance and a high level of efficiency under the model. Ref. [1] suggested one of the first tools to join robustness and efficiency, i.e., trimming some outliers identified with the aid of least absolute deviations followed by the computation of the least squares estimator from the remaining data. For the linear model, several proposals with the same purpose followed. An adaptive combination of the least squares and the least absolute deviations estimators was introduced by [2]. Their approach could be adapted in order to achieve the minimum asymptotic variance over a scale family of densities. Ref. [3] proposed MM estimators, which have a 50 % breakdown point and asymptotic efficiency as close to one as desired. Ref. [4] proposed τ estimates, which combine the same two properties as MM estimators. Ref. [5] introduced adaptive cutoff values based on an initial highly robust and possibly inefficient estimator (such as an S estimator) to define a region Z such that observations out of Z are considered as outliers. The maximum likelihood (ML) estimator is then computed after removal of the outliers. Since, under the model, Z tends to the whole space for increasing sample size, the final estimator is asymptotically fully efficient. A similar idea was used by [6] to compute a highly robust and fully efficient truncated ML estimator for regression with asymmetric errors. Ref. [7] used the adaptive cutoff values to define adaptive weights for a least weighted squares estimator, which is asymptotically efficient and highly robust.
Several robust methods for the generalized linear model (GLM) have also been proposed. Ref. [8] made use of diagnostic tools based on ML residuals. This tool may, however, be affected by the well-known “masking effect” of ML residuals described in [9] (Section 4.3). Other authors introduced different types of M estimators ([10,11,12,13,14,15], among others) where the trade-off between robustness and efficiency is controlled by means of one or more tuning constants. A fully efficient and highly robust estimator was proposed in [16] using a conditional ML principle, after removal of outliers not belonging to an adaptive region which tends to the whole space.
Unfortunately, when n is not very large, the finite sample efficiency of most estimators, including the fully efficient ones, may be much smaller than the asymptotic one. To overcome this shortcoming, ref. [17] proposed a regression estimator with the maximum breakdown point and high finite sample efficiency. However, the method suffers from a serious loss of robustness. Ref. [18] introduced a general method to improve the finite sample efficiency of a robust estimator. Details were given only for the cases of the linear model and the multivariate location and scatter of a random vector. The method assumes that an initial robust estimator, not necessarily with high finite sample efficiency, is available. Then, the improved estimator—called the distance constrained maximum likelihood (DCML) estimator—maximizes the likelihood function subject to the estimate being sufficiently close to the initial one. As a distance, the Kullback-Leibler divergence from the maximum likelihood estimated model was chosen. For the linear model, it turns out that the final estimator is a convex combination of the robust and the maximum likelihood estimator. In principle, the procedure may be applied to any parametric model; however, for the GLM, the solution of the constrained optimality problem is more involved.
In this paper, we consider a simple modification of the DCML principle for the GLM. The modification exploits only the most crucial elements of the original proposal: it directly defines the DCML as a convex combination of the robust and the ML estimator and uses a quadratic distance between the coefficients. We explore the performance of the DCML method by means of Monte Carlo experiments considering some well-known robust estimators, for which the public domain R software is available, as initial estimators. To limit our presentation, we focus on the Poisson model. We first compare the efficiency and robustness of the initial estimators in a simple regression case. We then select the best starting estimators and assess the performance of the DCML in critical multiple regression scenarios for p = 5 , 10, 20, and n = 5 p , when the covariables follow a spherical normal distribution or a spherical t distribution with four degrees of freedom. We finally describe a bootstrap experiment with real hospital length of stays fitted by a negative binomial regression model.

2. Candidate Estimators and Software for Poisson Regression

We consider the following families of robust estimators for Poisson regression:
-
the conditionally unbiased bounded influence estimators [10];
-
the robust quasi-likelihood estimators [11];
-
the transformed M estimators [13];
-
the minimum density power divergence estimators [14];
-
the modified conditionally maximum likelihood estimators (MCML) [16].
For short definitions of the CUBIF, RQL, and MT estimators and their tuning parameters, we refer to [9]. CUBIF is computed with the help of the R package “robcbi”; a function to compute the RQL estimators is provided in “robustbase”, and functions to compute the MT estimators can be found in the R package “poissonMT”. There is no public domain software to compute MD estimators, but the loss function defined in [14] can easily be minimized with the help of the R function “optim”. However, since the loss function of MD estimators may have multiple local minima, we use a specialized subsampling algorithm to find the absolute minimum with a high probability.
Particular attention is given to the MCML estimator. The MCML starts with the computation of a highly robust, but possibly inefficient initial estimator. Using randomized quantile residuals [19] based on this estimator, outliers are detected with the help of adaptive cutoff values as in [5,6]. Finally, a conditional ML estimator is computed, where observations are constrained to belong to a region free of detected outliers. Since in the absence of outliers, this region tends to the whole space when the sample size increases, the asymptotic efficiency of the MCML estimator is 100 % . For moderate sample sizes, the MCML markedly improves the efficiency of the initial estimator; unfortunately, for small sample sizes, the MCML efficiency is disappointingly low; nevertheless, the MCML maintains a similar degree of robustness as the initial estimator. It turns out, however, that the MCML is a good candidate for the DCML method. Computational tools to compute the MCML estimator are made available in the R package “robustnegbin”. In the original paper, as well as in the package, the initial step is based on a combination of the maximum rank correlation estimator [20] and CUBIF. Here, we propose a simpler version, where the initial step is replaced by an MD estimator.

3. The DCML for GLM

We consider a GLM:
y | x f μ x , σ ( y | x )
relating a response y to a p-components explanatory covariate x . The conditional expected response E ( y | x ) = μ x depends on a linear predictor β 0 T x through a link function g, i.e., β 0 T x = g ( μ x ) , where β 0 is a p-component vector of coefficients. In addition, σ is a dispersion parameter. In this paper, we focus on the Poisson regression model with the log-link, i.e., β 0 T x = log ( μ x ) and σ = 1 , which may be extended to the negative binomial (NB) model with σ 1 . We also write μ x = h ( β 0 T x ) , where h is the inverse of g; in the Poisson case, μ x = exp ( β 0 T x ) . If an intercept term is present, we sometimes use the notations x T = ( 1 , x * T ) and β 0 T = ( α , β 0 * T ), where α is the intercept.
Suppose that β ^ K is a robust consistent estimator of β 0 , not necessarily efficient, and that β ^ H is the ML estimator of β 0 . We measure the distance between β ^ K and β ^ H by:
Δ β ^ K , β ^ H = β ^ K β ^ H T C ^ 1 β ^ K β ^ H ,
where C ^ is a robust estimate of the covariance matrix of β ^ K β ^ H . We define the DCML estimator β ^ D as the convex combination:
β ^ D = t β ^ H + ( 1 t ) β ^ K
such that t minimizes Δ t β ^ H + ( 1 t ) β ^ K , β ^ H under the constraint:
Δ t β ^ H + ( 1 t ) β ^ K , β ^ K δ
and δ is an adequately chosen constant. It immediately follows that the optimal t is:
t 0 = min 1 , δ Δ β ^ K , β ^ H
as in Formula (8) in [18].
Under the model and for large n, the distribution of Δ ( β ^ K , β ^ H ) is approximately χ p 2 . Therefore, in order to control the efficiency of β ^ D , it seems reasonable to take δ as a quantile of the χ p 2 distribution such that the efficiency attains a satisfactory level. Monte Carlo simulation shows that a large quantile is usually required because the finite sample distribution of Δ ( β ^ K , β ^ H ) may be much more skewed than χ p 2 .
We compare a few candidate estimators β ^ K for which the R software is easily available. These candidates belong to the M estimator family (see e.g., [9]). Asymptotically, an M estimator β ^ K of regression is a functional of the cdf F of ( x , y ) , satisfying an estimating equation:
E F ψ ( x , y , β ^ K ) x = 0 ,
where ψ ( x , y , β ) is a given function that may depend on the model parameters. The influence function of β ^ K is:
I F K ( x , y , F ) = ψ ( x , y , β ^ K ) M K 1 x ,
where:
M K = E F ψ ( x , y , β ^ K ) xx T
and ψ ( x , y , β ) = / β ψ ( x , y , β ) . The asymptotic covariance matrix of β ^ K is given by:
V K = E F I F K ( x , y , F ) I F T ( x , y , F ) T = M K 1 Q K M K 1 ,
where:
Q K = E F ψ ( x , y , β ^ K ) 2 xx T .
The ψ functions and the influence functions of the candidate estimators of Poisson regression are provided in Appendix A. For the ML estimator, we have:
M H = E μ ^ x xx T , Q H = E y μ ^ x 2 xx T , V H = E μ ^ x xx T 1 .
The covariance matrix C of β ^ K β ^ H is obtained with the help of the influence functions I F H ( x , y , F ) and I F K ( x , y , F ) :
C = E F ( I F H ( x , y , F ) I F K ( x , y , F ) ) ( I F H ( x , y , F ) I F K ( x , y , F ) ) T
i.e.,
C = V H + V K ( M H 1 K H K M K 1 + M K 1 K H K M H 1 ) ,
where:
K H K = E F y μ ^ x ψ ( x , y , β ^ K ) xx T .
The distribution F is of the form F ( y | x ) G ( x ) . To estimate the cdf F ( y | x ) , we use the cdf F μ ^ x , σ ^ K ( y | x ) where μ ^ x = h ( β ^ K T x ) and σ ^ K is a robust estimate of σ ( σ ^ K = 1 in the Poisson case). Using the empirical cdf G n ( x ) to estimate G, we obtain:
Q ^ K = 1 n i ψ ( x i , y i , β ^ K ) 2 x i x i T , M ^ K = 1 n i ψ ( x i , y i , β ^ K ) x i x i T , K ^ H K = 1 n i y i μ ^ x i ψ ( x i , y i , β ^ K ) x i x i T ,
etc. In general, these estimates are not robust. Therefore, as often proposed, we remove all the observations such that M d ( x i * ) 2 > q p 1 , 0.95 , where M d is the Mahalanobis distance of the point x i * from the center of the covariate distribution based on a very robust (with a maximum 50 % breakdown point) covariance such as the minimum volume ellipsoid [21] enclosing 80 % of the sample and q p 1 , 0.95 is the 95 % quantile of a χ p 1 2 distribution. In the simple regression case, we remove observations such that | x i median ( x i ) | 2 × MAD ( x i ) . We then obtain an estimate of C ^ of C replacing M k , V K , M H , V H , and K H K by their robust estimates in (10). Note that, in order to have a positive definite C ^ , the same robust estimates β ^ K and μ ^ x = h ( β ^ K T x ) must be used in the evaluation of M ^ k , V ^ K , as well as M ^ H , V ^ H , and K ^ H K .
It is easy to show that, for any fixed weight t, the total variance of β ^ D is smaller than the total variance of β ^ K . Unfortunately β ^ D is not robust in this case. Nevertheless, under the model, Δ ( β ^ K , β ^ H ) is very often smaller than δ , and t 0 equals one; therefore, we may expect that β ^ D is more efficient than β ^ K . This is confirmed by the simulations in Section 6.
The constraint (3) makes the optimal t 0 a data dependent weight. Since x -outliers are removed, the eigenvalues of C ^ 1 are bounded away from zero. Let λ 0 > 0 be the smallest eigenvalue. Then,
λ 0 β ^ K β ^ D 2 β ^ K β ^ D T C ^ 1 β ^ K β ^ D = Δ β ^ K , β ^ D δ
implies that β ^ D cannot be unbounded when β ^ K is bounded; in other words, β ^ D has the same breakdown point as β ^ K . A formal proof for the linear model case when β ^ K is an MM estimator was provided by [18]. The empirical results in Section 6 show that, for the best candidates β ^ K , the DCML β ^ D is highly resistant to heavy point contaminations.
A method to compute an approximate distribution that can be used in the GLM case was also proposed in [18]. We note that the DCML estimator is a nonlinear function of β ^ H and β ^ K , and its distribution is not necessarily normal.

4. Some Invariance Properties

In general, Poisson regression does not own regression invariance—as in the linear model case—and the Monte Carlo results depend on the chosen coefficients, as well as on the distribution of the predictors. Unfortunately, this makes it impossible to draw very general conclusions. We restrict our attention to spherical and elliptical distributions of x . For these models, the following results may be used to expand the results to a certain extent beyond those provided by the reported experiments.
As usual, we measure the error of β ^ K by the mean squared estimation error:
MSEE F ( β ^ K ) = E F β ^ K β 0 2
or by the mean squared prediction error:
MSPE F ( β ^ K ) = E F β ^ H x β 0 x 2 .
The efficiency of β ^ K with respect to the ML estimator β ^ H is measured by:
Eff 1 ( β ^ K ) = MSEE F ( β ^ H ) / MSEE F ( β ^ K )
or by:
Eff 2 ( β ^ K ) = MSPE F ( β ^ H ) / MSPE F ( β ^ K ) .
Note that MSEE F ( β ^ K ) = trace ( V K ) , the total variance of β ^ K .
We consider two models with no intercept and slope vectors β 1 , β 2 . We denote by F k x the cdf of ( x , y ) when β 0 is replaced by β k ( k = 1 , 2 ) in (1). Let T ( F ) be the functional form of a consistent estimator and let V ( F k x ) its asymptotic covariance under F k x .
Theorem 1.
Suppose that x has a spherical distribution with center 0 and that β 1 and β 2 are two slope vectors with the same Euclidean norm. Then, trace V ( F 1 x ) = trace V ( F 2 x ) .
Proof. 
Let P be the orthogonal matrix such that β 2 = P β 1 and let z = Px . Let F k z be the cdf of ( z , y ) when the slope vector is β k . We have V ( F 2 z ) = P V ( F 1 z ) P T . Since x is spherically distributed V ( F 2 z ) = V ( F 2 x ) , V ( F 1 z ) = V ( F 1 x ) . Then, trace V ( F 1 x ) = trace V ( F 2 x ) . □
If an intercept term is present, a similar argument applies to a spherically distributed x * and the slope vector β * . It follows that, if x * has a spherical distribution, the asymptotic efficiency just depends on the intercept and on the norm of the slope vector. This allows us to restrict attention to coefficient vectors of the form β T = ( α , β * T ) for a varying intercept α and β * T = ( γ , 0 , , 0 ) T for a varying γ . In the Monte Carlo simulations of Section 6, we choose values of α and γ that make the empirical efficiency of the estimators under study very low. We explore the efficiency improvement provided by the DCML procedure in such unfavorable cases.
The case where x * is not centered in 0 can be led back to the centered case by changing the intercept term.
In the case where x has an elliptical distribution such that x = Az , where A is a regular p × p matrix and z has a spherical distribution with E ( z ) = 0 and E ( zz T ) = I p 1 , we define γ 0 = A T β 0 , γ ^ H = A T β ^ H , γ ^ K = A T β ^ K . Then, MSPE F ( β ^ K ) = MSEE ( γ ^ K ) and Eff 2 ( β ^ K ) = MSEE ( γ ^ H ) / MSEE ( γ ^ K ) . Thus, using the MSPE, the elliptical case can be led back to the spherically symmetric case.

5. Monte Carlo Scenarios for Poisson Regression

We examine the following specific candidate estimators of Poisson regression:
-
CUBIF11: CUBIF with tuning parameter b = 1.1 2 ;
-
CUBIF18: CUBIF with tuning parameter b = 1.8 2 ;
-
RQL01: RQL with tuning parameter t c c = 0.1 ;
-
RQL14: RQL with default tuning parameter t c c = 1.4 ;
-
MTI: the initial value of MT provided by poissonMT;
-
MT23: MT with default tuning parameter c c = 2.3 ;
-
MD04: MD with tuning parameter τ = 0.4 ;
-
MD07: MD with tuning parameter τ = 0.7 ;
-
MD10: MD with tuning parameter τ = 1.0 ;
-
MCML04: MCML starting from MD04r;
-
MCML07: MCML starting from MD07r;
-
MCML10: MCML starting from MD10r.
We consider both the case where leverage points are not removed and the case where they are removed. If necessary, to avoid confusion, a suffix “r” in the estimator name is added in the second case (e.g., MD04r, MD07r, etc.). The estimators CUBIF11, RQL01, MTI, and MD10 are (close to) the most robust, but are inefficient representatives of their families. In principle, they can be used as starting values to compute two stage estimators such as the MCML estimators. The estimators CUBIF18, RQL14, MT23, MD04, MD07, MCML04, MCML07, and MCML10 are considered as robust and efficient estimators.
Any estimator of this list can act as a β ^ K candidate in a DCML procedure. However, to illustrate the performance of the DCML, we first reduce the number of candidates on the grounds of their efficiency and robustness levels evaluated with the help of a quick Monte Carlo experiment. For this purpose, we use a simple Poisson regression model:
y | x f μ x ( y | x ) = μ x exp ( μ x ) ,
where μ x = exp ( β 0 x ) and β 0 = ( 1 , 0.25 ) , x = ( 1 , x * ) T , x * N ( 0 , 1 ) .
In a second set of experiments, we explore the DCML procedure starting at selected candidates. We use Poisson regression models with p coefficients:
y | x f μ x ( y | x ) = μ x y exp ( μ x ) ,
where μ x = exp ( β 0 x ) , β 0 T = ( α , β 0 * T ) , β 0 * T = ( γ , 0 , , 0 ) T , x T = ( 1 , x * T ) . The intercept α is considered as a nuisance parameter. Simulations are performed for α = 1 , two values of γ ( γ = 0.25 and 0.50 ), three values of p ( p = 5 , 10, 20), and two distributions of x * : x * N ( 0 , I p 1 ) and x * t 4 ( 0 , I p 1 ) .
To measure the quality of an estimator β ^ , we use the empirical MSEE:
MSEE n ( β ^ * ) = mean β ^ i # β 0 * 2 ,
where β ^ i # is the estimate of β 0 * based on the ith replication. It turns out that for most robust estimators, a very small fraction of errors β ^ i # β 0 * 2 is extremely large. This is a well-known feature of robust estimators, and as [22] noted, “despite its seductive simplicity, the ordinary variance is not an adequate measure of performance of a robust estimate: it is much too sensitive to the irrelevant extreme tail behavior of the estimate”. We therefore use the upper 1 % trimmed mean (in place of the usual mean) to evaluate the MSEE (13).
The following “simple” DCML estimators are compared:
-
MD07r + D: DCML starting from MD07r
-
MD10r + D: DCML starting from MD10r
-
MCML07 + D: DCML starting from MCML07
-
MCML10 + D: DCML starting from MCML10.
In addition, the following DCML “iterated” estimators are considered:
-
MCML+: MCML starting from (MD10r + DCML)
-
MCML*: MCML starting from (MCML + DCML)
as well as:
-
MCML++: DCML starting from MCML+
-
MCML*+: DCML starting from MCML*.

6. Monte Carlo Results for Poisson Regression

6.1. Simulations for the Nominal Simple Regression Model

In a first experiment, we drew 1000 samples of size 100 from Model (11). To compare the candidate estimators, we first computed the finite sample efficiencies Eff 1 n and the asymptotic efficiencies reported in Table 1. The results of the first column were obtained using the complete (unweighted) data. To compute the second column, leverage points such that | x i median ( x i ) | 2 × MAD ( x i ) were removed, except for the MCML estimators. We observe that the efficiencies of CUBIF, RQL, MT, and MD depend, as expected, on the choice of the tuning parameters; with the full data, they are slightly lower than their asymptotic values and markedly lower when leverage points are removed. By definition, the MCML estimators remove data points only when they are discordant with the fitted model and hence are asymptotically fully efficient. In our experiment with n = 100 , their finite sample efficiencies are almost independent of the starting estimator MD04, MD07, or MD10. Further experiments reported below show, however, that for smaller n, the efficiency of the MCML is directly related to the efficiency of the starting estimator. In any case, the MCML efficiencies are disappointingly lower than their asymptotic value of one.

6.2. Simulations for the Contaminated Simple Regression Model

In a second experiment, samples from Model (11) were corrupted with point contaminations of the form ( ( 1 , x out ) T , y out ) where x out varied in the set { 3 , 2 , 1 , 0 , 1 , 2 , 3 , 4 , 5 } and y out varied in the set 0 , 1 , 2 , 10 , 20 , 30 , 40 , 60 . This kind of contamination is generally the least favorable one and allows the evaluation of the maximal bias an estimator can incur. We generated 100 samples of size 90; then, for each pair ( x out , y out ) , we added 10 observations with identical outliers of the form ( ( 1 , x out ) T , y out ) ; thus, the contamination level was 10 % .
We first compared the four less efficient estimators: CUBIF11r, RQL01r, MTIr, and MD10r. The MSEEs of these estimators are displayed in Figure 1 as functions of y out . For x out = 3 , 3 , 4 , 5 , 6, the MSEEs of all estimators are very small because leverage points are removed and the graphs for x out 3 are not shown. Important differences are observed for x out between 2 and 2, and MD10r clearly provides the overall most robust behavior. For this reason, MD10r is considered as a good starting value for the MCML estimator MCML10.
Then, we compared the more efficient estimators RQL14, MT23, MD04, and MCML10. As Figure 2 shows, MCML10 generally provides the lowest MSEE. We conclude that MCML10 has a good robustness level and a full asymptotic efficiency, but a poor finite sample efficiency. It is therefore a natural candidate to study the performance of the DCML procedure.

6.3. Simulations for the Nominal Multiple Regression Model

To compare the DCML estimators, we first used 1000 samples of size n = 5 p from Model (12) for p = 5 , 10, 20 and computed empirical efficiencies Eff 1 n . It turns out that the efficiency of the MD estimators is a decreasing function of | γ | ; however, its dependence on α is quite weak (e.g., Figure 3). In addition, experiments with x * t 4 ( 0 , I p 1 ) and γ a bit larger than 0.5 or α > 1 gave rise to computational crashes due to the occurrence of extremely high values of exp ( β ^ K x ) . This suggests that α = 1 , γ = 0.5 , x * t 4 ( 0 , I p 1 ) is already a quite unfavorable scenario. We report the results for this case in Table 2. Results for the more favorable choice α = 1 , γ = 0.25 , x * t 4 ( 0 , I p 1 ) are shown in Table 3. As expected, higher efficiencies were obtained with the same values of γ and α , but for x * N ( 0 , I p 1 ) ; they are not reported.
The DCML procedure was computed for several values of δ , but only the results for δ = χ p , 0.0 2 = 0 , δ = χ p , 0.5 2 , δ = χ p , 0.95 2 , and δ = χ p , 0.99 2 are shown. Note that the results corresponding to δ = 0 are the efficiencies of the starting estimators. We observe that for p = 5 ( n = 25 ) and p = 10 ( n = 50 ), MD07r and MD10r are extremely inefficient. MCML07 and MCML10 somehow improve them, but are still very inefficient; they can exceed a 90 % efficiency level only for n = 100 . Good efficiency levels for all values of p (and n) are attained when the DCML procedure is started with MCML+ and MCML*, i.e., with MCML++ and MCML*+.

6.4. Simulations for the Contaminated Multiple Regression Model

In a final experiment, samples from Model (12) with p = 10 , γ = 0.5 , α = 1 , and x * N ( 0 , I p 1 ) were corrupted with point contaminations of the form ( ( 1 , x out ) T , y out ) , where x out = ( 0 , x o , 0 , , 0 ) , x 0 varied in the set { 2 , 1 , 1 , 2 , 3 , 4 , 5 , 6 , 7 } and y out in 0 , 1 , 2 , 10 , 20 , 30 , 40 , 50 . We generated 100 samples of size 90; then, for each pair ( x out , y out ) , we added 10 observations with identical outliers of the form ( ( 1 , x out ) T , y out ) ; thus, the contamination level was 10 % . Figure 4 shows the MSEE of the starting estimators as functions of y out ; MCML10 is clearly the overall most robust one. Figure 5 shows the MSEE of the simple DCML estimators with δ = χ p , 0.99 2 ; here, MCML10 + D has the best behavior. In Figure 6, MCML10 + D is compared to the iterated DCML estimators MCML++ and MCML*+; the three graphs are almost superimposable. The numerical values of the maximum (over y out ) MSEE can be found in Table 4. It is worth noting that the robust estimators are quite sensitive to point contaminations in the neighborhood of zero (“excess zeros”), a problem that deserves further research. The DCML procedure lessens this kind of sensitivity.

7. Bootstrapping Real Data and NB Fits

We consider 92 hospital stays belonging to the Major Diagnostic Category “polytrauma” of the SwissDRG system. These data were described in [16], where the relationship between “length of stay” (y in days) and four covariates—“number of diagnosis” ( x 1 ), “number of treatments” ( x 2 ), “age of the patient” ( x 3 in years), and “sex of the patient” ( x 4 = 0 for males and x 4 = 1 for females)—was analyzed. Overdispersion is a usual feature of this kind of data, and the NB regression model has often been proposed to take it into account. In [16] an NB model with predictor exp ( β 0 + β 1 x 1 + β 2 x 2 + β 3 x 3 + β 4 x 4 + β 5 x 3 x 4 ) was estimated using the MCML procedure. The contamination fraction based on the MCML procedure was estimated at about 10 % .
In a first experiment, we drew 1000 samples with a replacement of size 92, and for each sample, we estimated the six coefficients and the dispersion parameter by means of the ML, MD10r, MCML10, and MCML10 + D estimators of NB regression. We then computed the bootstrap coefficient means and standard errors, after 1 % trimming of the most extreme cases. In addition, we also computed the ( 1 % trimmed) total variance of the estimates. The results are reported in Table 5. We observe that the coefficient means are a bit lower than those reported in [16]; the most important difference between ML and MCML10 is the estimated intercept. However, the standard errors are somewhat larger than those based on asymptotic approximations. The standard errors and total variance of MD10r are the largest ones; those of MCML10 and ML are smaller and very similar. As expected, the DCML procedure (with δ = χ p , 0.99 2 ) makes MCML10 closer to ML; however, it does not improve the variance estimates and does not seem to be very valuable in this case.
In a second experiment, we drew 1000 bootstrap samples of size 50 taken from a subset of the original data. Unfortunately, our estimation procedures of the six parameter model experienced several numerical malfunctions because many subsamples had ill-conditioned model matrices. We therefore used the four parameter predictor exp ( β 0 + β 1 x 1 + β 2 x 2 + β 3 x 3 ) . The results are shown in Table 6. We observe that the robust intercept means are still lower than the ML means. We also notice the awfully large standard errors of the MCML10 coefficient estimates due to their extreme tail behavior shown in the boxplots of Figure 7. Nevertheless, the DCML succeeds in getting rid of these tails and substantially reduces the standard errors and total variance.
Remark: In our bootstrap experiments, several numerical breakdowns occurred. Both the function “glm.nb” (from the R package “MASS”) and our subsampling algorithm to compute MD10r stopped working in the presence of ill-conditioned model matrices. Other computations failed due to the occurrence of extreme predicted values, and remedies had to be implemented. For n = 50 , a subsampling algorithm based on the Poisson model was used to compute the initial coefficient estimates followed by the solution of the MD10r equation for the NB dispersion parameter. As noted in Marazzi et al. (2019, Remark 5), although this procedure does not provide consistent initial coefficients under the NB model, the final MCML estimates are consistent. In addition, both for n = 50 and n = 92 , samples associated with extreme predictions (larger than 25,000) were rejected to avoid program breakdowns. In the subsampling procedures, these samples were simply replaced with harmless ones, but we did not touch the “glm.nb” and “optim” functions. For these reasons, some of the results in Table 5 and Table 6 are based on less than 1000 samples; the number of rejections is reported.

8. Conclusions

Robust estimators may be very inefficient when the sample size is not large; this shortcoming is also frequent for asymptotically fully efficient estimators. As a remedy, Ref. [18] introduced the DCML method in the linear model case. In this paper, we introduced a simple modification of the original DCML that can be used for the GLM. The new DCML is simply defined as the convex combination of the robust and the ML estimator that minimizes a quadratic distance from the ML estimator under the constraint that the distance from the robust estimator is smaller than a given bound δ .
With the help of Monte Carlo experiments, we explored the performance of the DCML in the particular case of Poisson regression. For this purpose, we introduced a simplified version of the fully efficient MCML estimator where a very robust MD estimator is used as the initial step. A small Monte Carlo comparison of several published competitors indicated that this MCML was a very good candidate for the DCML procedure. We also introduced two iterated versions of the DCML procedure.
Unfortunately, Poisson regression is not regression invariant. This makes it difficult to infer general conclusions from the Monte Carlo experiments, in particular to find a general rule to set the bound δ . It seems, however, that a large quantile of the χ p 2 distribution ( δ χ p , 0.95 2 ) is a convenient choice. We restricted our experiments to the case of spherical distributions of the covariates showing that, in this case, the efficiency essentially depends on the length of the slope vector. Monte Carlo experiments were based on a very unfavorable design. We observed, however, that the small sample efficiency of our best starting estimator MCML10 could be remarkably improved—without loss of robustness—with the help of the DCML method. It seems therefore reasonable to assume that the procedure works in practice as has been shown in an example with hospital length of stay fitted with the help of an NB regression model.

Funding

This research received no external funding.

Data Availability Statement

The data used in Section 6 are available in the R package “robustnegbin”.

Acknowledgments

I am very grateful to Ricardo Maronna and Victor Yohai for their critical remarks.

Conflicts of Interest

The author declares no conflict of interest.

Appendix A

The candidate estimators belong to the M estimator family (see e.g., [9]). In general, M estimators are defined by an “estimating equation” (5). The influence function, the matrices M K and Q K , and the asymptotic variance V K of a general M estimator are given by (6)–(9), respectively. The special cases used in the Monte Carlo experiments are considered here.
The CUBIF estimator: The estimating equation of the CUBIF estimator with tuning parameter b is:
E F φ b / | z | y c ( x T β , b / | z ) h ( x T β ) x = 0 ,
where φ a ( s ) = max a , min s , a is Huber’s function, z = Ax , A satisfies:
A E F φ b / | z | ( y c ( x T β , b / | z | ) h ( x T β ) 2 xx T A T = I p ,
and the bias correction function c ( ϑ , a ) is defined by:
φ a y c ( ϑ , a ) h ( ϑ ) f h ( ϑ ) ( y ) d y = 0 .
Thus, the ψ -function of the CUBIF estimator is:
ψ ˜ ( x , y , β ) = φ b / | z | ( y c ( x T β , b / | z | ) h ( x T β ) ) .
We have:
M K = E F ψ ˜ ( x , y , β ) ( y h ( x T β ) ) xx T ,
Q K = E F ψ ˜ ( x , y , β ) 2 xx T .
The RQL estimator: The estimating equation of the RQL estimator with tuning parameter c is:
E F φ c y μ x μ x 1 / 2 μ x 1 / 2 x α ( β ) = 0 ,
where φ c is Huber’s function and:
α ( β ) = E F φ c y μ x μ x 1 / 2 μ x 1 / 2 x .
Thus, the ψ -function of the RQL estimator is:
φ c y μ x μ x 1 / 2 μ x 1 / 2 x α ( β ) .
The formulae to compute M K and Q K were given in [10]. The function “glmrob” in “robustbase” implements these formulae.
The MD estimator: The estimating equation of the MD estimator with tuning parameter τ is:
E F γ ( μ x ) ( y μ x ) f μ x ( y ) τ x = 0 ,
where γ ( μ ) = k = 1 ( k μ ) f μ ( k ) 1 + τ . We obtain:
M K = E γ ( μ x ) μ x + μ x τ ( y μ x ) 2 f μ x ( y ) τ xx T ,
Q K = E γ ( μ x ) ( y μ x ) f μ x ( y ) τ 2 xx T ,
where:
γ ( μ ) = k = 1 q ( k , μ , τ ) ,
and:
q ( k , μ , τ ) = 1 + ( k μ ) ( 1 + τ ) ( k / μ 1 ) f μ ( k ) τ + 1 .
The MT estimator: The estimating equation of the MT estimator with tuning parameter c is:
E ρ c ( y m ( μ x ) ) m ( μ x ) μ x x = 0 ,
where ρ c is Tukey’s biweight:
ρ c ( u ) = 1 max 1 u c 2 3 , 1 ,
m ( μ ) is the consistency correction function:
m ( μ ) = arg min γ E ρ c ( y ) γ .
We have:
M K = E ρ c ( y m ( μ x ) m ( μ x ) 2 μ x 2 + ρ c ( y m ( x T β ) ) ( m ( μ x ) μ x 2 + μ x xx T ,
Q K = E ρ c ( y m ( μ x ) ) 2 m ( μ x ) 2 μ x 2 xx T .
The MCML estimator: The MCML estimator is based on the conditional density of y given x and z [ a , b ] , where z U [ 0 , 1 ] . This distribution can be written as:
p μ x ( y | z [ a , b ] ) = f μ x ( y ) W a , b ( μ x ) ,
where W a , b ( μ x ) is defined in the following. For any c, let:
y x * ( c ) = max { y : F μ x ( y ) c }
and:
t c , x = ( F μ x ( y x * ( c ) + 1 ) c ) / f μ x ( y x * ( c ) + 1 ) ,
where F μ denotes the cdf of f μ . Put:
T a , x = y x * ( a ) + 2 , T b , x = y x * ( b ) ,
A x = { y : T a , x y T b , x } ,
Q ( μ x ) = F μ x ( T b , x ) F μ x ( T a , x 1 ) + f μ x ( T a , x 1 ) t a , x + f μ x ( T b , x + 1 ) ( 1 t b , x ) ,
L x = { y | y = T a , x 1 } , A x = y | T a , x y T b , x , U x = y | y = T b , x + 1 ,
H x = L x A x U x .
Then:
W a , b ( μ x ) = 1 Q ( μ x ) if y A x , t a , x Q ( μ x ) if y L x , 1 t b , x Q ( μ x ) if y U x , 0 if elsewhere .
We approximately compute the influence function assuming that a and b are fixed. The estimating equation is:
E F ψ ¯ ( x , y , μ x ) h ( x T β ) x = 0 ,
i.e.:
T a , x 1 k T b , x + 1 ψ ¯ ( x , k , μ x ) h ( x T β ) x p ( k | x ) d G ( x ) = 0 ,
where:
ψ ¯ ( x , y , μ x ) = s ( y , μ x ) D ( μ x ) if y A x t a , x s ( y , μ x ) D ( μ x ) if y L x ( 1 t b , x ) s ( y , μ x ) D ( μ x ) if y U x 0 otherwise
s ( y , μ ) = / μ ln f μ ( y ) = y μ 1 ,
D ( μ ) = μ ln Q ( μ ) .
We obtain:
M K = E F ψ ¯ μ ( x , y , μ x ) h ( x T β ) 2 + ψ ( x , y , μ x ) h ( x T β ) xx T ,
Q K = E F ψ ¯ ( x , y , μ x ) 2 h ( x T β ) 2 xx T ,
where ψ μ ( y , μ ) = / μ ψ ( y , μ ) .

References

  1. Taylor, L.D. Estimation by minimizing the sum of absolute errors. In Frontiers in Econometrics; Zarembka, P., Ed.; Academic Press: New York, NY, USA, 1973; pp. 189–190. [Google Scholar]
  2. Dodge, Y.; Jurečková, J. Adaptive combination of least squares and least absolute deviations estimators. In Statistical Data Analysis Based on L1-Norm and Related Methods; Dodge, Y., Ed.; Springer: New York, NY, USA, 2000. [Google Scholar]
  3. Yohai, V.J. High breakdown-point and high efficiency robust estimates for regression. Ann. Stat. 1987, 15, 642–656. [Google Scholar] [CrossRef]
  4. Yohai, V.J.; Zamar, R.H. High breakdown estimates of regression by means of the minimization of an efficient scale. J. Am. Stat. Assoc. 1988, 83, 406–413. [Google Scholar] [CrossRef]
  5. Gervini, D.; Yohai, V.J. A class of robust and fully efficient regression estimators. Ann. Stat. 2002, 30, 583–616. [Google Scholar] [CrossRef]
  6. Marazzi, A.; Yohai, V.J. Adaptively truncated maximum likelihood regression with asymmetric errors. J. Stat. Plan. Inference 2004, 122, 271–291. [Google Scholar] [CrossRef]
  7. Čižek, P. Semiparametrically weighted robust estimation of regression models. Comput. Stat. Data Anal. 2011, 55, 774–788. [Google Scholar] [CrossRef]
  8. Davison, A.C.; Snell, E.J. Residuals and diagnostics. In Statistical Theory and Modelling: In Honour of Sir David Cox; Hinkley, D.V., Reid, N., Snell, E.J., Eds.; Chapman and Hall: London, UK, 1991; pp. 83–106. [Google Scholar]
  9. Maronna, R.A.; Martin, R.D.; Yohai, V.J. Robust Statistics; Wiley: Hoboken, NJ, USA, 2019. [Google Scholar]
  10. Künsch, H.R.; Stefanski, L.A.; Carroll, R.J. Conditionally unbiased bounded-influence estimation in general regression models, with applications to generalized linear models. J. Am. Stat. Assoc. 1989, 84, 460–466. [Google Scholar]
  11. Cantoni, E.; Ronchetti, E. Robust inference for generalized linear models. J. Am. Stat. Assoc. 2011, 96, 1022–1030. [Google Scholar] [CrossRef] [Green Version]
  12. Neykov, N.M.; Filzmoser, P.; Neytchev, P.N. Robust joint modeling of mean and dispersion through trimming. Comput. Stat. Data Anal. 2012, 56, 34–48. [Google Scholar] [CrossRef]
  13. Valdora, M.; Yohai, V.J. Robust estimation in generalized linear models. J. Stat. Plan. Inference 2014, 146, 31–48. [Google Scholar] [CrossRef]
  14. Ghosh, A.; Basu, A. Robust Estimation in Generalized Linear Models: The Density Power Divergence Approach. TEST 2016, 25, 269–290. [Google Scholar] [CrossRef] [Green Version]
  15. Aeberhard, W.H.; Cantoni, E.; Heritier, S. Robust inference in the negative binomial regression model with an application to falls data. Biometrics 2014, 70, 920–931. [Google Scholar] [CrossRef] [PubMed]
  16. Marazzi, A.; Valdora, M.; Yohai, V.J.; Amiguet, M. A robust conditional maximum likelihood estimator for generalized linear models with a dispersion parameter. Test 2019, 28, 223–241. [Google Scholar] [CrossRef]
  17. Bondell, H.D.; Stefanski, L.A. Efficient robust regression via two-stage generalized empirical likelihood. J. Am. Stat. Assoc. 2013, 108, 644–655. [Google Scholar] [CrossRef] [PubMed]
  18. Maronna, R.A.; Yohai, V.J. High finite sample efficiency and robustness based on distance-constrained maximum likelihood. Comput. Stat. Data Anal. 2015, 83, 262–274. [Google Scholar] [CrossRef] [Green Version]
  19. Dunn, P.K.; Smyth, G.K. Randomized quantile residuals. J. Comput. Graph. Stat. 1996, 5, 236–244. [Google Scholar]
  20. Han, A.K. Non-parametric analysis of a generalized regression model: The maximum rank correlation estimator. J. Econom. 1987, 35, 303–316. [Google Scholar] [CrossRef]
  21. Rousseeuw, P.J. Multivariate estimation with high breakdown point. In Mathematical Statistics and Applications; Grossman, W., Pflug, G., Vincze, I., Wertz, W., Eds.; Reidel Publishing: Dordrecht, The Netherlands, 1985; pp. 283–297. [Google Scholar]
  22. Huber, P.J. The 1972 Wald Lecture, Robust Statistics: A Review. Ann. Math. Stat. 1972, 43, 1041–1067. [Google Scholar] [CrossRef]
Figure 1. Monte Carlo results for the contaminated simple regression model. Mean square estimation error MSEE( β ^ ) for varying y out and x out . CUBIF11r, red; RQL01r, green; MT-Ir, blue; MD10r, black.
Figure 1. Monte Carlo results for the contaminated simple regression model. Mean square estimation error MSEE( β ^ ) for varying y out and x out . CUBIF11r, red; RQL01r, green; MT-Ir, blue; MD10r, black.
Stats 04 00008 g001
Figure 2. Monte Carlo results for the contaminated simple regression model. Mean square estimation error MSEE( β ^ ) for varying y out and x out . RQL14, green; MT23, blue; MD04, orange; MCML10, black.
Figure 2. Monte Carlo results for the contaminated simple regression model. Mean square estimation error MSEE( β ^ ) for varying y out and x out . RQL14, green; MT23, blue; MD04, orange; MCML10, black.
Stats 04 00008 g002
Figure 3. Efficiency of MD07 (blue) and MD10 (black) as a function of γ (solid) and of α (broken): x * N ( 0 , I p 1 ) , n = 5000 , p = 5 ; the solid line is obtained with α = 1 and γ [ 1.5 , 1.5 ] ; the broken line is obtained with γ = 0.5 , and α [ 1.5 , 1.5 ] .
Figure 3. Efficiency of MD07 (blue) and MD10 (black) as a function of γ (solid) and of α (broken): x * N ( 0 , I p 1 ) , n = 5000 , p = 5 ; the solid line is obtained with α = 1 and γ [ 1.5 , 1.5 ] ; the broken line is obtained with γ = 0.5 , and α [ 1.5 , 1.5 ] .
Stats 04 00008 g003
Figure 4. Monte Carlo results for the contaminated multiple regression model. Mean square estimation error MSEE( β ^ * ) for varying y out and x out . Starting estimates: MD07r, light green; MD10r, cyan; MCML07, grey; MCML10, black; (ML, orange).
Figure 4. Monte Carlo results for the contaminated multiple regression model. Mean square estimation error MSEE( β ^ * ) for varying y out and x out . Starting estimates: MD07r, light green; MD10r, cyan; MCML07, grey; MCML10, black; (ML, orange).
Stats 04 00008 g004
Figure 5. Monte Carlo results for the contaminated multiple regression model. Mean square estimation error MSEE( β ^ * ) for varying y out and x out . Simple DCML estimates: MD07r + D, light green; MD10r + D, cyan; MCML07 + D, grey; MCML10 + D, black.
Figure 5. Monte Carlo results for the contaminated multiple regression model. Mean square estimation error MSEE( β ^ * ) for varying y out and x out . Simple DCML estimates: MD07r + D, light green; MD10r + D, cyan; MCML07 + D, grey; MCML10 + D, black.
Stats 04 00008 g005
Figure 6. Monte Carlo results for the contaminated multiple regression model. Mean square estimation error MSEE( β ^ * ) for varying y out and x out . Iterated DCML estimates: MCML++, pink; MCML*+, red; (MCML10 + D, black).
Figure 6. Monte Carlo results for the contaminated multiple regression model. Mean square estimation error MSEE( β ^ * ) for varying y out and x out . Iterated DCML estimates: MCML++, pink; MCML*+, red; (MCML10 + D, black).
Stats 04 00008 g006
Figure 7. Boxplots of the coefficient estimates β ^ 0 , β ^ 1 , β ^ 2 , and β ^ 3 of the NB model for length of stays ( n = 50 ); A = ML, B = MD10r, C = MCML10, D = MCML + D.
Figure 7. Boxplots of the coefficient estimates β ^ 0 , β ^ 1 , β ^ 2 , and β ^ 3 of the NB model for length of stays ( n = 50 ); A = ML, B = MD10r, C = MCML10, D = MCML + D.
Stats 04 00008 g007
Table 1. Efficiencies of the robust Poisson regression candidates: Eff 1 n is the empirical efficiency based on complete data; Eff 1 n r is the empirical efficiency based on cleaned data; Eff 1 is the asymptotic efficiency. CUBIF, conditionally unbiased bounded influence estimator; RQL, robust quasi-likelihood estimator; MT, transformed M estimator; MD, minimum density power divergence estimator; MCML, modified conditionally maximum likelihood estimator.
Table 1. Efficiencies of the robust Poisson regression candidates: Eff 1 n is the empirical efficiency based on complete data; Eff 1 n r is the empirical efficiency based on cleaned data; Eff 1 is the asymptotic efficiency. CUBIF, conditionally unbiased bounded influence estimator; RQL, robust quasi-likelihood estimator; MT, transformed M estimator; MD, minimum density power divergence estimator; MCML, modified conditionally maximum likelihood estimator.
EstimatorEff 1 n Eff 1 n rEff 1
CUBIF110.620.520.66
CUBIF180.890.730.92
RQL010.680.540.66
RQL140.940.750.93
MT-I0.850.78—-
MT230.870.700.90
MD040.840.670.89
MD070.750.600.79
MD100.660.540.68
MCML040.78—-1.00
MCML070.78—-1.00
MCML100.78—-1.00
Table 2. Monte Carlo efficiencies (%) of the MDE and MCML estimators of the Poisson regression for γ = 0.5 , α = 1 , x * t 4 ( 0 , I p 1 ) .
Table 2. Monte Carlo efficiencies (%) of the MDE and MCML estimators of the Poisson regression for γ = 0.5 , α = 1 , x * t 4 ( 0 , I p 1 ) .
pn δ MDE07rMDE10rMCML07MCML10MCML+MCML*
525 χ p , 0.00 2 262236325462
525 χ p , 0.50 2 614767598087
525 χ p , 0.95 2 836683768893
525 χ p , 0.99 2 887389829194
1050 χ p , 0.00 2 221842385669
1050 χ p , 0.50 2 543972647990
1050 χ p , 0.95 2 715182738593
1050 χ p , 0.99 2 775685778794
20100 χ p , 0.00 2 221957557384
20100 χ p , 0.50 2 544586849498
20100 χ p , 0.95 2 685691899799
20100 χ p , 0.99 2 746193919799
Table 3. Monte Carlo efficiencies (%) of the MDE and MCML estimators of the Poisson regression for γ = 0.25 , α = 1 , x * t 4 ( 0 , I p 1 ) .
Table 3. Monte Carlo efficiencies (%) of the MDE and MCML estimators of the Poisson regression for γ = 0.25 , α = 1 , x * t 4 ( 0 , I p 1 ) .
pn δ MDE07rMDE10rMCML07MCML10MCML+MCML*
525 χ p , 0.00 2 474258557883
525 χ p , 0.50 2 737284819597
525 χ p , 0.95 2 858793919899
525 χ p , 0.99 2 909196949999
1050 χ p , 0.00 2 403567658287
1050 χ p , 0.50 2 676691899799
1050 χ p , 0.95 2 7879969499100
1050 χ p , 0.99 2 8384979599100
20100 χ p , 0.00 2 393779788993
20100 χ p , 0.50 2 6569969599100
20100 χ p , 0.95 2 73799897100100
20100 χ p , 0.99 2 77939898100100
Table 4. Monte Carlo maximum MSEE (over y out 0 , 1 , 2 , 10 , 20 , 30 , 40 , 50 ) of the starting and DCML estimators of the Poisson regression under 10 % point contamination in ( ( 1 , x out ) T , y out ) , where x out = ( 0 , x o , 0 , , 0 ) ( p = 10 , γ = 0.5 , α = 1 , x * N ( 0 , I p 1 ) ).
Table 4. Monte Carlo maximum MSEE (over y out 0 , 1 , 2 , 10 , 20 , 30 , 40 , 50 ) of the starting and DCML estimators of the Poisson regression under 10 % point contamination in ( ( 1 , x out ) T , y out ) , where x out = ( 0 , x o , 0 , , 0 ) ( p = 10 , γ = 0.5 , α = 1 , x * N ( 0 , I p 1 ) ).
x 0 2 1 1234567
MDE07r0.12 0.100.120.140.160.150.160.140.12
MDE10r0.12 0.130.120.150.150.160.170.160.12
MCML070.11 0.090.100.130.140.140.140.130.11
MCML100.11 0.090.100.130.130.140.140.130.11
MDE07r + D0.11 0.080.080.100.130.120.140.130.10
MDE10r + D0.13 0.100.090.130.120.130.130.130.11
MCML07 + D0.09 0.060.070.080.120.110.130.120.09
MCML10 + D0.08 0.060.070.090.100.100.110.110.09
MCML++0.09 0.060.060.080.110.110.110.120.09
MCML*+0.10 0.060.060.080.120.110.110.120.09
Table 5. Bootstrap coefficient means and standard errors of the ML, MDE10r, MCML10, and MCML10 + D estimators of the negative binomial (NB) regression for length of stay data ( n = 92 ); var is the total variance; rej is the number of rejected samples.
Table 5. Bootstrap coefficient means and standard errors of the ML, MDE10r, MCML10, and MCML10 + D estimators of the negative binomial (NB) regression for length of stay data ( n = 92 ); var is the total variance; rej is the number of rejected samples.
β 0 β 1 β 2 β 3 β 3 β 3 α varrej
ML2.070.020.03−0.010.090.000.880.490
(0.47)(0.03)(0.02)(0.01)(0.52)(0.01)
MD10r1.560.020.06−0.010.420.010.670.850
(0.54)(0.05)(0.04)(0.01)(0.74)(0.02)
MCML101.700.020.05−0.010.290.01)0.480.511
(0.43)(0.04)(0.04)(0.01)(0.57)(0.02)
MCML10 + D1.950.020.04−0.010.150.010.790.3945
(0.45)(0.03)(0.02)(0.01)(0.50)(0.01)
Table 6. Bootstrap coefficient means and standard errors of the ML, MDE10r, MCML10, and MCML10 + D estimators of the NB regression for length of stay data ( n = 50 ); var is the total variance; rej is the number of rejected samples.
Table 6. Bootstrap coefficient means and standard errors of the ML, MDE10r, MCML10, and MCML10 + D estimators of the NB regression for length of stay data ( n = 50 ); var is the total variance; rej is the number of rejected samples.
β 0 β 1 β 2 β 3 α varrej
ML2.040.040.020.000.930.418
(0.64)(0.04)(0.03)(0.01)
MD10r1.590.040.020.000.850.990
(0.99)(0.08)(0.07)(0.02)
MCML101.720.040.040.000.521.702
(1.21)(0.35)(0.31)(0.14)
MCML10 + D1.920.030.020.000.860.468
(0.67)(0.05)(0.04)(0.01)
Publisher’s Note: MDPI stays neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Share and Cite

MDPI and ACS Style

Marazzi, A. Improving the Efficiency of Robust Estimators for the Generalized Linear Model. Stats 2021, 4, 88-107. https://0-doi-org.brum.beds.ac.uk/10.3390/stats4010008

AMA Style

Marazzi A. Improving the Efficiency of Robust Estimators for the Generalized Linear Model. Stats. 2021; 4(1):88-107. https://0-doi-org.brum.beds.ac.uk/10.3390/stats4010008

Chicago/Turabian Style

Marazzi, Alfio. 2021. "Improving the Efficiency of Robust Estimators for the Generalized Linear Model" Stats 4, no. 1: 88-107. https://0-doi-org.brum.beds.ac.uk/10.3390/stats4010008

Article Metrics

Back to TopTop