An alternative measure of uncertainty related to residual lifetime function is the dynamic cumulative residual entropy which plays a significant role in reliability and survival analysis. This article deals with estimating dynamic cumulative residual Rényi entropy (DCRRE) for Lomax distribution using maximum likelihood and Bayesian methods of estimation. The maximum likelihood estimates and approximate confidence intervals of DCRRE are derived. Bayesian estimates and Bayesian credible intervals are derived based on gamma priors for the DCRRE under squared error, linear exponential (LINEX) and precautionary loss functions. The Metropolis-Hastings algorithm is employed to generate Markov chain Monte Carlo samples from the posterior distributions. The Bayes estimates are compared through Monte Carlo simulations. Regarding simulation results, we observe that the maximum likelihood and Bayesian estimates of the DCRRE are decreasing function on time. Further, maximum likelihood and Bayesian estimates of the DCRRE perform well as the sample size increases. Bayesian estimate of the DCRRE under LINEX loss function is more convenient than the other estimates in the most of the situations. Real data set is analyzed for clarifying purposes.
Citation: Abdulhakim A. Al-Babtain, Amal S. Hassan, Ahmed N. Zaky, Ibrahim Elbatal, Mohammed Elgarhy. Dynamic cumulative residual Rényi entropy for Lomax distribution: Bayesian and non-Bayesian methods[J]. AIMS Mathematics, 2021, 6(4): 3889-3914. doi: 10.3934/math.2021231
Related Papers:
[1]
Abdullah Ali H. Ahmadini, Amal S. Hassan, Ahmed N. Zaky, Shokrya S. Alshqaq .
Bayesian inference of dynamic cumulative residual entropy from Pareto Ⅱ distribution with application to COVID-19. AIMS Mathematics, 2021, 6(3): 2196-2216.
doi: 10.3934/math.2021133
[2]
Baria A. Helmy, Amal S. Hassan, Ahmed K. El-Kholy, Rashad A. R. Bantan, Mohammed Elgarhy .
Analysis of information measures using generalized type-Ⅰ hybrid censored data. AIMS Mathematics, 2023, 8(9): 20283-20304.
doi: 10.3934/math.20231034
[3]
M. G. M. Ghazal .
Modified Chen distribution: Properties, estimation, and applications in reliability analysis. AIMS Mathematics, 2024, 9(12): 34906-34946.
doi: 10.3934/math.20241662
[4]
Refah Alotaibi, Mazen Nassar, Zareen A. Khan, Wejdan Ali Alajlan, Ahmed Elshahhat .
Entropy evaluation in inverse Weibull unified hybrid censored data with application to mechanical components and head-neck cancer patients. AIMS Mathematics, 2025, 10(1): 1085-1115.
doi: 10.3934/math.2025052
[5]
Haiping Ren, Ziwen Zhang, Qin Gong .
Estimation of Shannon entropy of the inverse exponential Rayleigh model under progressively Type-Ⅱ censored test. AIMS Mathematics, 2025, 10(4): 9378-9414.
doi: 10.3934/math.2025434
[6]
Amal S. Hassan, Najwan Alsadat, Oluwafemi Samson Balogun, Baria A. Helmy .
Bayesian and non-Bayesian estimation of some entropy measures for a Weibull distribution. AIMS Mathematics, 2024, 9(11): 32646-32673.
doi: 10.3934/math.20241563
[7]
Samah M. Ahmed, Abdelfattah Mustafa .
Estimation of the coefficients of variation for inverse power Lomax distribution. AIMS Mathematics, 2024, 9(12): 33423-33441.
doi: 10.3934/math.20241595
[8]
Ehab M. Almetwally, Ahlam H. Tolba, Dina A. Ramadan .
Bayesian and non-Bayesian estimations for a flexible reduced logarithmic-inverse Lomax distribution under progressive hybrid type-Ⅰ censored data with a head and neck cancer application. AIMS Mathematics, 2025, 10(4): 9171-9201.
doi: 10.3934/math.2025422
[9]
Mansour Shrahili, Mohamed Kayid .
Rényi entropy of past lifetime from lower $ k $-record values. AIMS Mathematics, 2024, 9(9): 24401-24417.
doi: 10.3934/math.20241189
[10]
Alaa M. Abd El-Latif, Hanan H. Sakr, Mohamed Said Mohamed .
Fractional generalized cumulative residual entropy: properties, testing uniformity, and applications to Euro Area daily smoker data. AIMS Mathematics, 2024, 9(7): 18064-18082.
doi: 10.3934/math.2024881
Abstract
An alternative measure of uncertainty related to residual lifetime function is the dynamic cumulative residual entropy which plays a significant role in reliability and survival analysis. This article deals with estimating dynamic cumulative residual Rényi entropy (DCRRE) for Lomax distribution using maximum likelihood and Bayesian methods of estimation. The maximum likelihood estimates and approximate confidence intervals of DCRRE are derived. Bayesian estimates and Bayesian credible intervals are derived based on gamma priors for the DCRRE under squared error, linear exponential (LINEX) and precautionary loss functions. The Metropolis-Hastings algorithm is employed to generate Markov chain Monte Carlo samples from the posterior distributions. The Bayes estimates are compared through Monte Carlo simulations. Regarding simulation results, we observe that the maximum likelihood and Bayesian estimates of the DCRRE are decreasing function on time. Further, maximum likelihood and Bayesian estimates of the DCRRE perform well as the sample size increases. Bayesian estimate of the DCRRE under LINEX loss function is more convenient than the other estimates in the most of the situations. Real data set is analyzed for clarifying purposes.
1.
Introduction
Entropy is a fundamental uncertainty measure of a random variable. Shannon [1] provided a quantitative measure of uncertainty as a measure of information. A flexible extension of Shannon entropy was introduced by Rényi [2]. The Rényi entropy is one parameter generalization of the Shannon entropy and can be used as a measure of randomness. Applications of Rényi entropy can be found in many fields, such as biology, genetics, electrical engineering, computer science, economics, chemistry and physics.
The Rényi entropy has been widely used in analysis of the quantum systems. It can be employed in the analysis of quantum communication protocols (Renner et al. [3]), quantum correlations (Lévay et al. [4]). Also it can be used to characterize the number of reads needed to reconstruct a DNA sequences (see, Motahari et al. [5]). Rényi entropy has numerous issues as a data analysis tools in many practical applications, especially in data that dealing with time-frequency representations. Gabarda and Cristobal [6] applied the Rényi entropy to an image fusion method and identified which pixels have a higher amount of information among the given input images. Rényi entropy can be used to calculate the risk measure of portfolio.
Entropy concepts can be related to informational market efficiency. Martina et al. [7] studied the complexity of crude oil prices using entropy measures to monitor the evolution of crude oil price movements. They found that the methods based on entropy concepts can shed light on the structure of crude oil markets as well as on its link to macroeconomic conditions and socio-political extreme events. Resconi et al. [8] provided a new suggestive reading of quantum mechanics by starting from the superposition of different Boltzmann entropies. They suggested that a quantum entropy space can be used as the fundamental arena that describing the quantum effects. Another measure of uncertainty deals with residual lifetime function is dynamic cumulative residual entropy (DCRE) which can be attractive in many fields like reliability and survival analysis. Recently, there are considerable literatures assigned to the applications, generalizations and properties of Rényi's measure of entropy.
Recently, there are many literatures studied the estimation procedure for the entropy measures. Kayal and Kumar [9] considered Bayesian estimation of entropy for exponential distribution under LINEX loss function. Seo et al. [10] produced an entropy estimate using upper record values from the generalized half-logistic distribution. Based on generalized progressive hybrid censoring scheme, Bayesian estimates of entropy for Weibull distribution were discussed by Cho et al. [11]. Based on record values, Chacko and Asha [12] studied the estimation of the entropy for generalized exponential distribution. Patra et al. [13] estimated a function of scale parameter of an exponential population under general loss function. Maximum likelihood (ML) estimate of Shannon entropy for inverse Weibull distribution under multiple censored data was discussed by Hassan and Zaky [14]. Petropoulos et al. [15] provided improved estimators of the entropy for the scale mixture of exponential distributions. Estimation of entropy for inverse Lomax distribution under multiple censored has been studied by Bantan et al. [16]. Bayesian estimate of the entropy for Lomax distribution based on upper record values has been studied by Hassan and Zaky [17].
If X is an absolutely continuous random variable with probability density function (PDF) f (x), then the corresponding Rényi entropy of order β is defined as:
IR(β)=11−βlog(∞∫−∞fβ(x)dx),β>0andβ≠1.
(1)
Recently, measurements of uncertainty for probability distributions became more interested. Sunoj and Linu [18] defined the cumulative residual Rényi entropy (CRRE) for residual lifetime Xt = (X −t | X > t) based on survival function instead of using PDF as follows:
γR(β)=11−βlog(∞∫0ˉFβ(x)dx),β>0andβ≠1,
(2)
where, ˉF(t)=P(X>t)=1−F(t) is the survival (reliability) function. The main features of the CRRE are always non-negative as well as it has consistent definitions in both the continuous and discrete domains. Furthermore it can be easily computed from sample data and these computations asymptotically converge to the true values (see, Rao et al. [19]). Sunoj and Linu [18] defined the DCRRE as a dynamic form of uncertainty as follows:
γR(β)=11−βlog(∞∫tˉFβ(x)ˉFβ(t)dx),β>0andβ≠1.
(3)
Therefore, when t = 0, the DCRRE tends to CRRE. In the literature, few studies had been done concerning the inferential procedures of the entropy measures incorporating DCRRE for lifetime distributions. Kamari [20] produced some properties of the DCRRE based on order statistics. Kundu et al. [21] presented the cumulative residual and past inaccuracy measures which are extensions of the corresponding cumulative entropies for truncated random variables. Renjini et al. [22] discussed the Bayesian estimates of the DCRRE for the Pareto distribution using Type II right censored data. Renjini et al. [23] discussed the Bayesian estimates of the DCRRE for Pareto distribution of the first kind under upper record values. Renjini et al. [24] obtained Bayesian estimate of the DCRRE for Pareto distribution based on complete data. Bayesian estimate of dynamic cumulative residual Shannon entropy for Pareto II distribution has been studied by Ahmadini et al. [25].
Lomax [26] proposed a very good alternative to the common lifetime distributions such as exponential, Weibull, or gamma when the experimenter presumes that the population distribution may be heavy-tailed. Lomax distribution can be applied in a variety of fields such as a business failure data model, income and wealth inequality, computer science, risk analysis and economics, actuarial science and reliability. Corbellini et al. [27] used it to model firm size and queuing problems. As an important lifetime distribution, the Lomax distribution with shape parameter α and scale parameter λ has the following PDF
f(x;α,λ)=αλα(x+λ)−(α+1),x,α,λ>0.
(4)
The cumulative distribution function (CDF) corresponding to (4) is given by,
F(x;α,λ)=1−λα(x+λ)−α,x,α,λ>0.
(5)
At λ=1,α≠1, Lomax distribution reduces to the beta prime distribution (also known as inverted beta distribution or beta distribution of the second kind). At α=1,λ≠1, Lomax distribution reduces to a log-logistic distribution. At α=λ=1, the Lomax distribution reduces to F-distribution, F (2, 2). The reliability and hazard rate functions of Lomax distribution are given, respectively, by
ˉF(x;α,λ)=λα(x+λ)−α,
and,
h(x;α,λ)=α(x+λ)−1.
The hazard rate function of Lomax distribution takes different shapes according to values of shape parameter α. It is a constant at α=1, and it is continuously decreasing at α>1, which represents early failures.
Studies about the Lomax distribution have been provided by many authors. For instance, Abd-Elfattah et al. [28] obtained the Bayesian and non-Bayesian estimates of the sample size for the Lomax distribution in case of Type-I censored samples. Record values of Lomax distribution were discussed by Ahsanullah [29]. Balakrishnan and Ahsanullah [30] introduced some recurrence relations between the moments of record values from Lomax distribution. Hassan and Al-Ghamdi [31] determined the optimum test plan for simple step stress accelerated life testing. Hassan et al. [32] discussed the optimal times of changing stress level for k-level step stress accelerated life tests based on adaptive Type-II progressive hybrid censoring with product's life time following Lomax distribution. For more application about Lomax distribution, the reader can refer to [33,34,35,36,37,38].
From the above, it is evident that the Lomax distribution has been received greatest attention from theoretical and statisticians primarily due to its use in various fields. In the literature, there are no reports about the statistical inference of the DCRRE for Lomax distribution. So we need to estimate the DCRRE for Lomax distribution in view of Bayesian and non-Bayesian procedures based on complete samples. The ML estimates and approximate confidence intervals of the DCRRE are obtained. The Bayesian estimate is calculated using gamma priors under squared error (SE), LINEX and precautionary (PRE) loss functions. According to the complicated forms of the DCRRE Bayesian estimate, we employ the Markov Chain Monte Carlo (MCMC) simulation technique for numerical study.
This article can be organized as follows. Section 2 gives the DCRRE of Lomax distribution as well as obtains the ML and approximate confidence intervals of DCRRE. Section 3 presents Bayesian estimate of the DCRRE for Lomax distribution under symmetric and asymmetric loss functions. The MCMC technique is given in Section 4. A real data application is illustrated in Section 5. The paper ends with some conclusions based on the results of the numerical studies.
2.
Maximum likelihood estimate of the DCRRE
This section provides an explicit expression of the DCRRE for Lomax distribution. Then, the ML estimate of the DCRRE is derived based on complete random sample.
The DCRRE of Lomax distribution is obtained by substituting (5) in (3) as follows:
γR(β)=11−βlog(∞∫t(x+λ)−αβ(t+λ)−αβdx).
(6)
Hence, after simplification the DCRRE takes the form
γR(β)=11−βlog(t+λαβ−1),β>0,β≠1andαβ>1.
(7)
This is the required expression of the DCRRE for Lomax distribution. To obtain the ML estimate of γR(β), we must obtain the ML estimate of the model parameters α and λ.
Consider a simple random sample of size n drawn from PDF (4) and CDF (5), where α and λ are unknown. Then, given the sample x_=(x1,x2,...,xn), the likelihood function of Lomax distribution can be written as follows
L(α,λ|x_)=αnλnαn∏i=1(xi+λ)−(α+1).
(8)
It is usually easier to maximize the natural logarithm of the likelihood function rather than the likelihood function itself. Therefore, the logarithm of likelihood function, say lnℓ, is
lnℓ=nlogα+nαlogλ−(α+1)n∑i=1log(xi+λ).
The partial derivatives of the log-likelihood function with respect to α and λ, are obtained as follows:
∂lnℓ∂α=nα+nlogλ−n∑i=1log(xi+λ),
(9)
and
∂lnℓ∂λ=nαλ−(α+1)n∑i=1(xi+λ)−1.
(10)
The ML estimates of α and λ are determined by solving the equations ∂lnℓ/∂lnℓ∂α∂α=0, and ∂lnℓ/∂lnℓ∂λ∂λ=0, simultaneously. Further the resulting equations cannot be solved analytically, so, numerical technique must be applied to solve these equations, simultaneously, to obtain ˆαML and ˆλML. The existence and uniqueness of ˆαML and ˆλML can be checked by solving, algebraically, ∂lnℓ/∂lnℓ∂α∂α=0 and ∂lnℓ/∂lnℓ∂λ∂λ=0, simultaneously and checking that, the second derivative is negative which is a maximum point.
Hence, by using the invariance property of ML estimate, then ML estimates of the DCRRE denoted by ˆγR,ML(β) becomes
Furthermore, a confidence interval of the DCRRE is the probability that a real value of the entropy will fall between an upper and lower bounds of a probability distribution. For large sample size, the ML estimates, under appropriate regularity conditions, are consistent and asymptotically normally distributed. Therefore, the two-sided approximate confidence limits for ˆγR,ML(β) can be constructed, such that
where, zη/η22 is 100 (1−η) the standard normal percentile, and η is the significant level. Therefore, the lower (L) and upper (U) confidence limits for ˆγR,ML(β) can be obtained as
where σ(ˆγR,ML(β)) is the standard deviation. The two-sided approximate confidence limits for DCRRE will be constructed with confidence level 95 %.
3.
Bayesian estimate of the DCRRE
In this section, the Bayesian estimates of γR(β) under symmetric (SE) and asymmetric (LINEX and PRE) loss functions are obtained by assuming the priors of parameters α and λ have gamma distributions. As reported by Kayal and Kumar [9], the SE loss function is used when weights of error caused by observation and underestimation are equal. But asymmetric loss function is used when the overestimation may have more serious than underestimation or vice versa. To compute the Bayesian estimate of γR(β), we proceed as follows. Firstly, the Bayesian estimates of α and λ are obtained and then the DCRRE estimate will be calculated by substituting the parameter estimates in (7). Additionally, the width of the Bayesian credible interval (BCI) estimates is obtained.
In Bayesian method, there are many methods that can be used in selection of prior. There are two types of the prior distributions, non-informative and informative prior (IP) distributions. The prior of parameters may be selected as independent or dependent priors. In this paper, we assume the prior of parameters α and λ, denoted by π1(α) and π2(λ) are independent. Following Pak and Mahmoudi [39], we take π1(α) and π2(λ) to be gamma distributions with parameters (a, b) and (c, d) as follows
π1(α)=abΓ(b)αb−1e−αa,π2(λ)=cdΓ(c2)λc−1e−λd,
(14)
where a, b, c and d are known and non-negative. So, the joint posterior for parameters, denoted by π∗1,2(α,λ), is
where, ν is a real number. Additionally, the Bayesian estimates of parameters α and λ under PRE loss function say ˆαPRE and ˆλPRE are given as follows:
Integrals (18)–(23) do not take a closed form, so the Metropolis-Hastings (M-H) and random-walk Metropolis algorithms are employed to generate the MCMC samples from posterior density functions (16) and (17), respectively. Hence, the Bayesian estimates of α and λ under SE, LINEX and PRE loss functions are obtained as the mean of the simulated samples from their posteriors. Further, once the Bayes estimates of α and λ are obtained. Therefore, the Bayesian estimate of the DCRRE, denoted by ˆγR,BE(β)SE, under SE loss function is obtained, by using (7), as follows:
ˆγR,BE(β)SE=11−βlog(t+ˆλSEˆαSEβ−1).
(24)
By similar way, we obtain the Bayesian estimate of γR(β) for Lomax distribution under LINEX, and PRE loss functions. Furthermore, the BCI is a useful summary of the posterior distribution which reflects its variation that is used to quantify the statistical uncertainty. An approximate highest posterior density interval of γR(β) is obtained by using the same algorithm of Chen and Shao [40].
4.
Monte Carlo simulation
This section evaluates the performance of the ML and Bayes estimates (BEs) based on simulation study.
The maximum likelihood estimates (MLEs) of the DCRRE for various sample sizes are computed by using Equations (9) and (10). Criteria measures include mean square error (MSE), average length (AL) and coverage probability (CP) are computed to investigate the performance of MLEs. Simulation procedures can be described as follows:
● 1000 random samples of sizes n = 30, 50, 70 and 100 are generated from Lomax distribution.
● The values of parameters are selected as α=(1.5,2.5),λ=(0.5,1.5,4) and β=(3,5).
● The true values of the DCRRE measure are selected as γR(β)= 0.2798, 0.6264 and 0.9359 at t = 0.5, while γR(β)= 0.077075, 0.2798 and 0.58932 at t = 1.5.
● The MLEs of α and λ are obtained from (9) and (10), then the MLE of γR(β) is obtained by substituting ˆαML and ˆλML in (11). The approximate confidence interval of ˆγR,ML(β) using (12) are constructed with confidence level at η=0.05.
● Compute the average MLEs of the DCRRE, MSEs, CPs, and ALs.
The M-H algorithm is one of the most famous subclasses of the MCMC method in Bayesian literature used to simulate the deviates from the posterior density and produce the good approximate results. The relative absolute biases (RABs), estimated risks (ERs) and the width of the BCI are computed to assess the behavior of the Bayesian estimates. A simulation study is done via R 3.1.2. Additionally, tables of simulation results are given. To compare the DCRRE Bayes estimates, the MCMC simulations are designed for different sample sizes under SE, LINEX and PRE loss functions. The values of parameters are selected as α=(1.5,2.5),λ=(0.5,1.5,4) and β=(3,5). The true values of the DCRRE measure are selected as γR(β)= 0.2798, 0.6264 and 0.9359 at t = 0.5, while γR(β)= 0.077075, 0.2798 and 0.58932 at t = 1.5. The hyper-parameters for gamma distribution are selected as a = c = 1 and b = d = 4. Also, we take (v = −2, 2) for LINEX loss function. Take N = 5000 random samples of sizes n, where each sample size (n) = 10, 30, 50, 70 and 100 are generated from Lomax distribution.
The M-H algorithm is described as follows:
Step 1: Let g(.) be the PDF of subject distribution;
Step 2: Initialize a starting value x0 and determine the number of samples N;
Step 3: for i = 2 to N set x=xi−1;
Step 4: Generate u from uniform (0, 1) and generate y from g(.);
Step 5: if u⩽πα(y)g(x)πα(x)g(y) then set xi=y else set xi=x;
Step 6: Set i=i+1 and return to step 2 and repeat the previous steps N times.
4.1. Numerical results based on ML method
Numerical observations for DCRRE estimates using ML method at β=3 and β=5 are presented in Tables 1–4 and represented in Figures 1–4. Some observations related to the behavior of the DCRRE estimates are outlined as follows:
Table 1.
MSE, AL and CP of 95% CI for DCRRE estimates of Lomax distribution at t = 0.5 and β=3.
● The value of MLE, ˆγR,ML(β), decreases as the value of λ increases for fixed value of α (see Tables 1 and 2)
● The value of MLE, ˆγR,ML(β), decreases as α decreases for fixed value of λ (see Tables 1 and 2).
● The value of MLE, ˆγR,ML(β), at α=1.5,λ=4 has the smallest value compared with the corresponding estimates of the other sets of parameters (see Tables 3 and 4).
● The MSE of ˆγR,ML(β) decreases as the sample size increases.
● For fixed value of λ, the MSE of ˆγR,ML(β) decreases as the value of α decreases.
● For fixed value of α, the MSE of ˆγR,ML(β) decreases as the value of λ increases.
● The MSE of the DCRRE estimates gets the smallest value at γR(β)=0.2798, where (α=1.5,λ=1.5),t = 0.5 and β=3, compared to the MSE of MLE of DCRRE measure for the corresponding other sets of parameters (see Figure 1).
● The MSE of the DCRRE estimates takes the smallest value at γR(β)=0.077075, where (α=1.5,λ=1.5),t = 1.5 and β=3, compared to MSE of MLE of DCRRE for the corresponding other sets of parameters (see Figure 2).
● At β=5,(α=1.5,λ=1.5), where the true value of γR(β)=0.2946637 the MSE of ˆγR,ML(β) has the smallest value compared to the MSE of MLEs for the corresponding other sets of parameters at t = 0.5 (see Figure 3).
● At t = 1.5, the MSE of ˆγR,ML(β) at (α=1.5,λ=4.0), has the smallest value compared to the MSE of MLEs for the corresponding other sets of parameters (see Figure 4).
Generally as seen from Tables 1–4 that the CP is very close to their corresponding nominal levels in approximately most of the cases. Also, the CP increases as the sample size increases for all values of DCRRE.
● The MLE of the DCRRE decreases as the value of λ increases.
● Regarding the AL of estimates, it can be observed that, as n increases the AL of DCRRE estimates decreases.
4.2. Numerical results based on Bayesian method
Tables 5–10 and Figures 5–8, list the numerical outcomes for different estimates of the DCRRE under different loss functions at β=3.Tables 11–14 and Figures 9–12, list and describe the simulation outcomes for different estimates of the DCRRE under different loss functions at β=5. Some observations related to the behavior of the DCRRE estimates are provided as follows:
Table 5.
Bayes estimates, RAB, ER and width of the DCRRE for Lomax distribution for (α,λ)=(1.5,1.5),t = 0.5 and β=3.
● As anticipated, the performance of all DCRRE estimates become improved as the sample size increases.
● The estimated value of the DCRRE increases as the value of α increases for fixed λ. The estimated value of the DCRRE decreases as the value of scale parameter λ increases for fixed α.
● The estimated value of the DCRRE decreases as the value of t increases for fixed values of α and λ.
● Under SE loss function, the ERs for DCRRE estimates get the smallest values at true value γR(β)= 0.6264, for most values of n (see for example Figures 5 and 6).
● The ER of ˆγR,BE(β)LINEX at v = −2 gets the smallest values for all values of n. Also, the width of the BCI for ˆγR,BE(β)LINEX at v = −2 is the shortest compared to the width of the BCI in case of the SE and PRE loss functions for all n (see Table 5).
● The ER of ˆγR,BE(β)SE takes the smallest values for all n except n = 100. The width of the BCI for ˆγR,BE(β)LINEX at v = −2 is the shortest compared to the width of the BCI in case of the PRE and SE loss functions for all n (see Table 6).
● The ER of ˆγR,BE(β)LINEX at v = −2 takes the smallest values for all values of n. The width of the BCI for ˆγR,BE(β)LINEX at v = −2 is the shortest compared to the width of the BCI in case of PRE and SE loss functions at n = 10 and 30 (see Table 7).
● At t = 1.5, the ERs for DCRRE estimates get the smallest values at γR(β)= 0.2798, for all n under SE and PRE loss functions (see for example Figures 7 and 8).
● The ER of ˆγR,BE(β)LINEX at v = 2 takes the smallest values at n = 50, 70 and 100, while the ER of ˆγR,BE(β)PRE takes the smallest values at n = 10 and 30. The width of the BCI for ˆγR,BE(β)SE is the shortest compared to the width of the BCI in case of LINEX and PRE loss functions for all values of n (see Table 8).
● The ER of ˆγR,BE(β)LINEX at v = −2 takes the smallest values at n = 50, 70 and 100, while the ER of ˆγR,BE(β)PRE takes the smallest values at n = 10 and 30. The width of the BCI of ˆγR,BE(β)LINEX at v = −2 is the shortest compared to the width of the BCI in case of the SE and PRE loss functions for all values of n (see Table 9).
● The ER of ˆγR,BE(β)LINEX at v = −2 takes the smallest values for n = 10, 70 and 100. The width of the BCI for ˆγR,BE(β)LINEX at v = −2 is the shortest compared to the width of the BCI in case of the SE and PRE loss functions for most values of n (see Table 10).
● At β=5, the ERs for DCRRE estimates get the smallest values at γR(β)= 0.0919312, for most values of n under most selected loss functions (see for example Figures 9 and 10).
● The ER of ˆγR,BE(β)LINEX at v = −2 gets the smallest values for all values of n. While, the width of the BCI for ˆγR,BE(β)LINEX at v = 2 is the shortest compared to the width of the BCI in case of the SE and PRE loss functions for all n (see Table 11).
● The ER of ˆγR,BE(β)LINEX at v = −2 gets the smallest values for all values of n. While, the width of the BCI for ˆγR,BE(β)SE is the shortest compared to the width of the BCI in case of the LINEX and PRE loss functions for all n expect at n = 10 (see Table 12).
● Under SE loss function, the ERs for DCRRE estimates get the smallest values at γR(β)= 0.04176352, for most values of n (see for example Figures 11 and 12).
● The ER of ˆγR,BE(β)LINEX at v = 2 gets the smallest values for n = 10, 70 and 100. While, the width of the BCI for ˆγR,BE(β)LINEX at v = 2 is the shortest compared to the width of the BCI in case of the SE and PRE loss functions for all n (see Table 13).
● The ER of ˆγR,BE(β)LINEX at v = 2 gets the smallest values for all values of n. While, the width of the BCI for ˆγR,BE(β)LINEX at v = −2 is the shortest compared to the width of the BCI in case of the SE and PRE loss functions for all n (see Table 14).
5.
Application to real data
In this section, we provide an application to real data set to prove the importance and flexibility of the Lomax distribution compared with some other models. Also, the real data set can be used to illustrate the proposed methods in Sections 2 and 3.
The real data set was used by Jorgensen [41] which represent the active repair times (in hours) for airborne communication transceiver. The data are recorded as follows:
Firstly, some preliminary data analysis is performed. The histogram, scaled total time on test (TTT) plots and the log likelihood for the real dataset are presented in Figure 13. We can observe that the shape of TTT plots is convex curve for dataset, which demonstrates decreasing failure rate.
Figure 13.
Estimated PDF, TTT plots and log likelihood of Lomax distribution for active repair times data for airborne communication transceiver.
Secondly, an application to a real data set is given to demonstrate the importance and flexibility of the proposed distribution compared with other one, two and three parameters fitted distributions. The suggested distributions are the alpha power Lindley (APLi) (Dey et al. [42]), Lindley (Li) and alpha power Weibull (APW) (Nassar et al. [43]) distributions. The MLE of the unknown parameters and the corresponding standard error (SE) of Lomax distribution and the other competitive models are calculated. In order to compare the different models with the Lomax model, we use measures like, Akaike information criterion (AIC), and Bayesian information criterion (BIC), consistent AIC (CAIC), Hannan-Quinn information criterion (HQIC). Also, the Kolmogorov- Smirnov (K-S) goodness of fit test and its P value (PV) for all models are calculated. Table 15 reports the MLEs and the corresponding SEs for all models. Table 16 reports numerical values of AIC, BIC, CAIC, HQIC, K-S and PVs for the different competitive distributions. From the results, we found that the Lomax distribution takes the smallest values of the considered measures and the largest value of PV among all other competitive models, and so it could be chosen as the best model.
As anticipated, we conclude from Table 17 that the DCRRE estimates are decreasing function on time (t), that is the estimated values of the DCRRE decrease as the time t increases.
6.
Conclusions
In this paper, the maximum likelihood and Bayesian methods of estimation for dynamic cumulative residual Rényi entropy of Lomax distribution are considered. The maximum likelihood estimates and approximate confidence intervals of the DCRRE are obtained. The performance of the DCRRE estimates for Lomax distribution is investigated via simulation in terms of their mean square error, average length and coverage probability. The Bayesian estimate of the DCRRE for Lomax model is obtained by considering the gamma priors under symmetric and asymmetric loss functions. The MCMC procedure is employed to compute the Bayes estimates and the Bayesian credible intervals. The performance of the DCRRE estimates for Lomax distribution is inspected through their relative absolute bias, estimated risk and the width of the credible intervals. Application to real data is provided.
Regarding the simulation results, we conclude that the mean square error of maximum likelihood and Bayesian estimates of the DCRRE decreases as the sample size increases. Also, the average length of the DCRRE estimates decreases and coverage probability increases as the sample size increases. The ER and the width of credible intervals of the DCRRE Bayes estimates decrease. For small true values of DCRRE, the width of DCRRE of BCIs under LINEX loss function is smaller than the corresponding based on SE and PRE loss functions for all selected sample size at t = 0.5 and 1.5. For large true values of DCRRE, the BCI width of the DCRRE under LINEX loss function is smaller than the corresponding based on SE and PRE loss functions for large sample size at t = 0.5 and 1.5.
Generally, the DCRRE estimates for both ML and Bayesian methods approach the true value as the sample size increases. As the time (t) increases, both ML and Bayesian estimates of the DCRRE decrease. Bayesian estimates under LINEX loss function at v = −2 are more suitable than other estimates under SE and PRC loss functions in most of the situations.
Acknowledgments
The authors thank the reviewers for their detailed and constructive comments. This project is supported by Researchers Supporting Project number (RSP-2020/156) King Saud University, Riyadh, Saudi Arabia. The first author, therefore, gratefully acknowledges the KSU for technical and financial support.
Conflict of interest
The authors declare no conflict of interest.
References
[1]
C. E. Shannon, A Mathematical Theory of Communication, Bell. Syst. Tech. J., 27 (1948), 379–432. doi: 10.1002/j.1538-7305.1948.tb01338.x
[2]
A. Rényi, On measures of Entropy and Information, Proc. Fourth Berkeley Symp. Math. Statist. Prob., 1 (1961), 547–561.
[3]
R. Renner, N. Gisin, B. Kraus, An Information-Theoretic Security Proof for Quantum-Key-Distribution Protocols, Phys. Rev. A., 72 (2005), 1–18.
[4]
P. Lévay, S. Nagy, J. Pipek, Elementary Formula for Entanglement Entropies of Fermionic Systems, Phys. Rev. A., 72 (2005), 1–8
S. Gabarda, G. Cristobal, Multifocus Image Fusion Through Pseudo-Wigner Distribution, Opt. Eng., 44 (2005), 1–9.
[7]
E. Martina, E. Rodriguez, R. Escarela-Perez, J. Alvarez-Ramirezd, Multiscale Entropy Analysis of Crude Oil Price Dynamics, Energy Econ., 33 (2011), 936–947.
[8]
G. Resconi, I. Licata, D. Fiscaletti, Unification of Quantum and Gravity by Non Classical Information Entropy Space, Entropy, 15 (2013), 3602–3619. doi: 10.3390/e15093602
[9]
S. Kayal, S. Kumar, Estimating the Entropy of an Exponential Population under the Linex Loss Function, J. Indian. Stat. Assoc. (JISA), 49 (2011), 91–112.
[10]
J. I. Seo, H. J. Lee, S. B. Kang, Estimation for Generalized Half Logistic Distribution Based on Records, J.Korea Inf. Sci.Soc., 23 (2012), 1249–1257.
[11]
Y. Cho, H. Sun, K. Lee, Estimating the Entropy of a Weibull Distribution Under Generalized Progressive Hybrid Censoring, Entropy, 17 (2015), 102–122. doi: 10.3390/e17010102
[12]
M. Chacko, P. S. Asha, Estimation of Entropy for Generalized Exponential Distribution Based on Record values, J. Indian Soc. Probab. Stat., 19 (2018), 79–96. doi: 10.1007/s41096-018-0033-4
[13]
L.K. Patra, S. Kayal, S. Kumar, Estimating a Function of Scale Parameter of an Exponential Population with Unknown Location under General Loss Function, Stat. Papers, 61 (2020), 2511–2527. doi: 10.1007/s00362-018-1052-7
[14]
A. S. Hassan, A. N. Zaky, Estimation of Entropy for Inverse Weibull Distribution Under Multiple Censored Data, J. Taibah. Univ. Sci., 13 (2019), 331–337. doi: 10.1080/16583655.2019.1576493
[15]
C. Petropoulos, L. K. Patra, S. Kumar, Improved Estimators of the Entropy in Scale Mixture of Exponential Distributions, Braz. J. Probab. Stat., 34 (2020), 580–593. doi: 10.1214/19-BJPS450
[16]
R. A. R. Bantan, M. Elgarhy, C. Chesneau, F. Jamal, Estimation of Entropy for Inverse Lomax Distribution under Multiple Censored Data, Entropy, 22 (2020), 601. doi: 10.3390/e22060601
[17]
A. S. Hassan, A. N. Zaky, Entropy Bayesian Estimation for Lomax Distribution Based on Record, Thail. Stat., 19 (2021), 96–115.
[18]
S. M. Sunoj, M. N. Linu, Dynamic Cumulative Residual Rényi's Entropy, Statistics, 46 (2012), 41–56. doi: 10.1080/02331888.2010.494730
[19]
M. Rao, Y. Chen, B. C. Vemuri, F. Wang, Cumulative Residual Entropy: A New Measure of Information, IEEE Trans. Inf. Theory, 50 (2004), 1220–1228. doi: 10.1109/TIT.2004.828057
[20]
O. Kamari, On Dynamic Cumulative Residual Entropy of Order Statistics, J. Stat. Appl. Prob., 5 (2016), 515–519. doi: 10.18576/jsap/050315
[21]
C. Kundu, A.D. Crescenzo, M. Longobardi, On Cumulative Residual (Past) Inaccuracy for Truncated Random Variables, Metrika, 79 (2016), 335–356. doi: 10.1007/s00184-015-0557-5
[22]
K. R. Renjini, E. I. Abdul Sathar, G. Rajesh, Bayes Estimation of Dynamic Cumulative Residual Entropy for Pareto Distribution Under Type-II Right Censored Data, Appl. Math. Model., 40 (2016), 8424–8434. doi: 10.1016/j.apm.2016.04.017
[23]
K. R. Renjini, E. I. Abdul Sathar, G. Rajesh, A Study of The Effect of Loss Functions On the Bayes Estimates Of Dynamic Cumulative Residual Entropy For Pareto Distribution Under Upper Record Values, J. Stat. Comput. Sim., 86 (2016), 324–339. doi: 10.1080/00949655.2015.1007986
[24]
K. R. Renjini, E. I. Abdul Sathar, G. Rajesh, Bayesian Estimation of Dynamic Cumulative Residual Entropy for Classical Pareto Distribution, Am. J. Math. Manage. Sci., 37 (2018), 1–13.
[25]
A. A. H. Ahmadini, A. S. Hassan, A. N. Zaky, S. S Alshqaq, Bayesian Inference of Dynamic Cumulative Residual Entropy from Pareto II Distribution with Application to COVID-19, AIMS Math., 6 (2020), 2196–2216.
[26]
K. S. Lomax, Business Failures: Another Example of the Analysis of Failure Data, J. Am. Stat. Assoc., 49 (1954), 847–852. doi: 10.1080/01621459.1954.10501239
[27]
A. Corbellini, L. Crosato, P. Ganugi, Mazzoli M, Fitting Pareto II Distributions on Firm Size: Statistical Methodology and Economic Puzzles, In: Advances in Data Analysis, 2010,321–328.
[28]
A. M. Abd-Elfattah, F. M Alaboud, H. A. Alharbey, On Sample Size Estimation for Lomax Distribution, Aust. J. Basic Appl. Sci., 1 (2007), 373–378.
N. Balakrishnan, M. Ahsanullah, Relations for Single and Product Moments of Record Values from Lomax Distribution, SankhyaB., 56 (1994), 140–146
[31]
A. S. Hassan, A. Al-Ghamdi, Optimum Step Stress Accelerated Life Testing for Lomax Distribution, J. Appl. Sci. Res., 5 (2009), 2153–2164.
[32]
A. S. Hassan, S. M. Assar, A. Shelbaia, Optimum Step-Stress Accelerated Life Test Plan for Lomax Distribution with an Adaptive Type-II Progressive Hybrid Censoring, J. Adv. Math. Comp. Sci.,13 (2016), 1–19.
[33]
A. S. Hassan, M. Abd-Allah, Exponentiated Lomax Geometric Distribution: Properties and Applications, Pak. J. Stat. Oper. Res., 13 (2017), 545–566.
[34]
A. S. Hassan, S. G Nassr, Power Lomax Poisson distribution: Properties and Estimation, J. Data Sci. (JDS), 16 (2018), 105–128.
[35]
A. S. Hassan, R. E. Mohamed, Parameter Estimation for Inverted Exponentiated Lomax Distribution with Right Censored Data, Gazi Univ. J. Sci., 32 (2019), 1370–1386. doi: 10.35378/gujs.452885
[36]
A. S. Hassan, M. A. H Sabry, A. Elsehetry, Truncated Power Lomax Distribution with Application to Flood Data, J. Stat. Appl. Prob., 9 (2020), 347–359. doi: 10.18576/jsap/090214
[37]
A. S. Hassan, M. Elgarhy, R. E. Mohamed, Statistical Properties and Estimation of Type II Half Logistic Lomax Distribution, Thail. Stat., 18 (2020), 290–305.
[38]
R. Bantan, A. S. Hassan, M. Elsehetry, Zubair Lomax Distribution: Properties and Estimation based on Ranked Set Sampling, CMC- Comput. Mater. Con., 65 (2020), 2169–2187.
[39]
A. Pak, M. R. Mahmoudi, Estimating the Parameters of Lomax Distribution from Imprecise Information, J. Stat. Theory Appl., 17 (2018), 122–135.
[40]
M. H. Chen, Q. M. Shao, Monte Carlo Estimation of Bayesian Credible and HPD Intervals, J. Comput. Graph. Stat., 8 (1999), 69–92.
[41]
B. Jorgensen, Statistical Properties of the Generalized Inverse Gaussian Distribution, Springer-Verlag, New York, 1982.
[42]
S. Dey, I. Ghosh, D Kumar, Alpha power transformed Lindley distribution: properties and associated inference with application to earthquake data, Ann. Data. Sci., 6 (2019), 623–650.
[43]
M. Nassar, A. Alzaatreh, M. Mead, O. Abo-Kasem, Alpha power Weibull distribution: Properties and applications, Commun. Stat. Theory Methods, 46 (2017), 10236–10252.
This article has been cited by:
1.
Abdulhakim A. Al-Babtain, Ibrahim Elbatal, Christophe Chesneau, Mohammed Elgarhy, Feng Chen,
Estimation of different types of entropies for the Kumaraswamy distribution,
2021,
16,
1932-6203,
e0249027,
10.1371/journal.pone.0249027
2.
Ahmed Sayed M. Metwally, Amal S. Hassan, Ehab M. Almetwally, B M Golam Kibria, Hisham M. Almongy,
Reliability Analysis of the New Exponential Inverted Topp–Leone Distribution with Applications,
2021,
23,
1099-4300,
1662,
10.3390/e23121662
3.
M. Shrahili, Ahmed R. El-Saeed, Amal S. Hassan, Ibrahim Elbatal, Mohammed Elgarhy, V. Vijayan,
Estimation of Entropy for Log-Logistic Distribution under Progressive Type II Censoring,
2022,
2022,
1687-4129,
1,
10.1155/2022/2739606
4.
Abdullah M. Almarashi, Ali Algarni, Amal S. Hassan, Ahmed N. Zaky, Mohammed Elgarhy,
Bayesian Analysis of Dynamic Cumulative Residual Entropy for Lindley Distribution,
2021,
23,
1099-4300,
1256,
10.3390/e23101256
5.
Baria A. Helmy, Amal S. Hassan, Ahmed K. El-Kholy,
Analysis of uncertainty measure using unified hybrid censored data with applications,
2021,
15,
1658-3655,
1130,
10.1080/16583655.2021.2022901
6.
Salem A. Alyami, Amal S. Hassan, Ibrahim Elbatal, Mohammed Elgarhy, Ahmed R. El-Saeed,
Bayesian and non-Bayesian estimation of dynamic cumulative residual Tsallis entropy for moment exponential distribution under progressive censored type II,
2023,
21,
2391-5471,
10.1515/phys-2022-0264
7.
Baria A. Helmy, Amal S. Hassan, Ahmed K. El-Kholy, Rashad A. R. Bantan, Mohammed Elgarhy,
Analysis of information measures using generalized type-Ⅰ hybrid censored data,
2023,
8,
2473-6988,
20283,
10.3934/math.20231034
8.
Amal S. Hassan, Najwan Alsadat, Oluwafemi Samson Balogun, Baria A. Helmy,
Bayesian and non-Bayesian estimation of some entropy measures for a Weibull distribution,
2024,
9,
2473-6988,
32646,
10.3934/math.20241563
Abdulhakim A. Al-Babtain, Amal S. Hassan, Ahmed N. Zaky, Ibrahim Elbatal, Mohammed Elgarhy. Dynamic cumulative residual Rényi entropy for Lomax distribution: Bayesian and non-Bayesian methods[J]. AIMS Mathematics, 2021, 6(4): 3889-3914. doi: 10.3934/math.2021231
Abdulhakim A. Al-Babtain, Amal S. Hassan, Ahmed N. Zaky, Ibrahim Elbatal, Mohammed Elgarhy. Dynamic cumulative residual Rényi entropy for Lomax distribution: Bayesian and non-Bayesian methods[J]. AIMS Mathematics, 2021, 6(4): 3889-3914. doi: 10.3934/math.2021231