Source-linked AI summary

Generalized extreme value regression for binary response data: An application to B2B electronic payments system adoption

Xia Wang, Dipak K. Dey

arXiv:1101.1373v1stat.AP

TL;DR

B2B technology-adoption studies seek predictions that can guide targeted promotions, but binary adoption data may be imbalanced and poorly served by a symmetric link. This paper introduces a flexible GEV link and reports better model-comparison results than Cloglog and symmetric links on the EPS data.

  • Problem

    For EPS adoption, predicting which firms are likely to adopt supports targeted promotions, while imbalanced binary outcomes may violate logistic regression’s symmetric-curve assumption.

    Source: §1 · p. 2
  • Method

    The paper uses the generalized extreme value distribution as a flexible skewed link for binary-response regression and evaluates prediction with holdout posterior predictive deviance.

    Source: §1 · pp. 3–4
  • Results

    446.68 versus 660.79 for DIC-16000: the GEV link scored lower than Cloglog, and both skewed links outperformed symmetric logit and probit.

    Source: §4.4 · p. 17
  • Takeaways & Limitations

    Accurate adoption predictions are the stated goal for targeting EPS promotions, and the GEV link is presented as a less computationally burdensome alternative to the GT-link.

    Source: §1 · p. 2, §5 · p. 19

    The GEV shape parameter ξ also affects tail heaviness, so it does not separately control skewness and tail weight.

    Source: §5 · p. 19

Abstract

from arXiv · show

In the information system research, a question of particular interest is to interpret and to predict the probability of a firm to adopt a new technology such that market promotions are targeted to only those firms that were more likely to adopt the technology. Typically, there exists significant difference between the observed number of ``adopters'' and ``nonadopters,'' which is usually coded as binary response. A critical issue involved in modeling such binary response data is the appropriate choice of link functions in a regression model. In this paper we introduce a new flexible skewed link function for modeling binary response data based on the generalized extreme value (GEV) distribution. We show how the proposed GEV links provide more flexible and improved skewed link regression models than the existing skewed links, especially when dealing with imbalance between the observed number of 0's and 1's in a data. The flexibility of the proposed model is illustrated through simulated data sets and a billing data set of the electronic payments system adoption from a Fortune 100 company in 2005.

1. Introduction.

Electronic payment adoption matters for B2B payment automation, while persistent check use makes predicting likely adopters a practical concern. Because adoption data can be imbalanced and response curves skewed, the paper motivates flexible links and proposes a GEV link.

  • Logistic regression assumes a symmetric response curve, an assumption that may be violated by imbalanced, skewed adoption data and risk link misspecification.Source: §1 · pp. 2–3
  • False logistic-link assumptions can increase bias and mean squared error in parameter estimates and predicted probabilities, especially when misspecification involves skewness rather than kurtosis.Source: §1 · p. 3
  • Earlier skewed-link approaches faced posterior-propriety or intercept-confounding problems, while the GT-link shape constraint narrowed its available skewness.Source: §1 · p. 3
  • The paper proposes the generalized extreme value (GEV) distribution as a flexible skewed link for binary data, with an unconstrained shape parameter that accommodates a wide range of skewness.Source: §1 · pp. 3–4
  • The paper compares models using DIC, BIC, marginal likelihood, and holdout posterior predictive deviance to assess out-of-sample accuracy and guard against overfitting.Source: §1 · p. 4

2. The electronic payment system data set.

The data set records firms’ payment choices and firm- and transaction-level characteristics for the vendor’s electronic payments system. Its imbalance and a reduced-sample comparison of link models illustrate the data’s skew and the motivation for a more flexible response curve.

2. The electronic payment system data set.

  • The data include payment choices and firm- and transaction-specific characteristics, including firm size, prior bill amount, PayDex credit risk, financing option, region, and industry.The observations concern firms financing large commercial equipment purchases with the vendor before 2005.Source: §2 · pp. 4–5
  • 10,784 of 15,175 transactions used traditional payment methods (EPS = 1), accounting for more than 70% of observations.The vendor offered ACH debits as a voluntary free service alongside conventional methods such as checks.Source: §2 · p. 5
  • In 1,618 Midwest manufacturing lease transactions, 1,222 used traditional methods; the reduced-sample model predicts EPS = 1 from normalized log firm size.The subset was selected to show response curves under different link models.Source: §2 · p. 5
  • The positively skewed Cloglog link fit the reduced-sample data better than logit and probit, but still showed a large discrepancy from observed values.The paper attributes the remaining discrepancy to data skewness exceeding the fixed skewness of the Cloglog link.Source: §2 · p. 6

3. Generalized extreme value link model.

The section develops a binary-response regression link based on the generalized extreme value distribution, whose shape parameter controls tail behavior and allows flexible skewness. It also describes Bayesian estimation and conditions under which the posterior is proper.

3. Generalized extreme value link model.

  • The model maps a binary response probability through a link defined by a cumulative distribution function, with logit and probit symmetric and Cloglog asymmetric.The section specifies independent binary responses and covariate vectors within the generalized linear model framework.Source: §3 · pp. 6, 8

3.1. The generalized extreme value distribution.

  • ξ controls the GEV distribution’s tail behavior, and ξ → 0 yields the Gumbel distribution.The GEV family includes the Gumbel, Fréchet, and Weibull classes.Source: §3.1 · pp. 8–9

3.2. The generalized extreme value link model.

  • GEV links provide a wider range of skewness than GT links with a specified distribution, even for ξ ∈ [−0.5, 0.5].The comparison uses the Arnold and Groeneveld skewness measure; Figure 3 contrasts the GEV and GT link curves.Source: Figure 3 · p. 10, §3.2 · p. 10
  • The GEV link can approximate a symmetric probit link between the 0.02 and 0.98 quantiles, with the main discrepancy in the tails.The approximation matches the first three moments of a standard normal distribution.Source: §3.2 · p. 10, Figure 4 · p. 11

3.3. Prior and posterior distributions for the generalized extreme value link model.

  • Unlike Stukel’s generalized logistic regression with covariates, GEV posteriors are proper under many noninformative priors, including Jeffreys’ and the improper uniform prior for β.The authors favor Bayesian analysis because maximum-likelihood regularity conditions are not satisfied when ξ < −0.5.Source: §3.3 · pp. 11–12
  • Under the stated design-matrix condition, the posterior is proper with an improper uniform prior on the regression coefficients.With ξ restricted to [−1, 1), the link retains skewness in [−0.7293, 1).Source: §3.3 · p. 12

4. Applications of generalized extreme value link models.

The applications compare link models using in-sample criteria and holdout prediction, then evaluate the GEV link on simulated data and EPS adoption data. Results show flexible fitting and strong prediction, while underscoring that response imbalance alone does not identify skewness.

4.1. Model comparison criterion.

  • DIC, marginal likelihood, and BIC assess model fit with complexity considerations, whereas posterior predictive deviance evaluates prediction on holdout data.The simulation setup uses data with around 70% response values of 1; the authors caution that imbalance is only an indicator of possible skewness, since it can also occur with a symmetric link.Source: §4.1 · pp. 12–13, §4.2 · pp. 13–14

4.2. Simulated data examples.

  • In Simulation ♯1, GEV outperforms logit even at n = 200, while in Simulation ♯2 it approximates probit and gains model-selection support mainly at larger sample sizes.Under Simulation ♯2, BIC and marginal likelihood select GEV over logit only at n = 5000.Source: §4.2 · p. 14

4.3. The motivation subset of the electronic payments system data.

  • The GEV response curve stretches to fit the observed EPS adoption values in the motivation subset, and holdout predictions are especially good for firms with normalized log sizes above 0.The holdout contains 173 transactions, including 135 with EPS = 1.Source: §4.3 · pp. 14, 16, Figure 5 · p. 15, Table 5 · p. 16

4.4. The electronic payment system data set.

  • 446.68 DIC for GEV is lower than 660.79 for Cloglog on the full EPS data, and both skewed links outperform symmetric logit and probit links.Marginal likelihood and BIC give consistent model comparisons.Source: §4.4 · p. 17, Table 6 · p. 17
  • GEV and logit estimates differ on EPS covariate effects, including the regional comparison and whether construction-industry transactions are significantly more likely to use EPS.GEV estimates a 7% higher probability for construction than wholesale trade, while logit estimates an approximately 3% effect that is not statistically significant.Source: §4.4 · p. 18
  • 1618.73 posterior predictive deviance for GEV, versus 1653.40 for logit, 1643.04 for probit, and 1637.92 for Cloglog, gives GEV the best holdout prediction on the full EPS data.The holdout set contains 1501 observations; the authors report no indication of overfitting.Source: §4.4 · p. 18

5. Conclusion and discussion.

The paper presents the GEV link as a flexible, computationally lighter alternative for skewed binary-response regression. Its shape parameter also affects tail heaviness, leaving room to separate those roles in future designs.

5. Conclusion and discussion.

  • The GEV link flexibly fits response-curve skewness and required about 2 minutes to fit in R for a two-covariate simulation, compared with about 8 hours for the GT link in FORTRAN 95.The authors describe the GEV computation burden as much lower.Source: §5 · p. 19
  • The proposed GEV link is presented for binary response data with covariates in the EPS adoption setting.Source: §5 · p. 19
  • The GEV shape parameter ξ affects both skewness-related flexibility and distribution tail heaviness, rather than controlling skewness alone.The authors identify separating skewness and tail-heaviness control as a way to further improve flexibility.Source: §5 · p. 19

APPENDIX

The appendix reports simulation evidence on GEV estimation, covariate effects, and model comparisons under Cloglog- and probit-generated data. Its results show that estimation and model-selection conclusions depend on sample size and comparison criterion.

Simulated data examples.

  • In Simulation ♯1, GEV coefficient estimates are close to the true Cloglog model, while shape-parameter uncertainty decreases as sample size rises from 200 to 5000.At n = 200, the 95% HPD interval for ξ includes the true value.Source: Simulated data examples · p. 20
  • GEV average covariate effects are closer to Cloglog than logit in Simulation ♯1, and holdout posterior deviance favors GEV and Cloglog over logit.DIC also favors GEV and Cloglog over logit; marginal likelihood and BIC align with those comparisons only at n = 5000.Source: Simulated data examples · pp. 20, 22, Table 7 · p. 21, Table 8 · p. 21
  • In Simulation ♯2, GEV shape-parameter intervals include the value approximating the standard normal distribution, but precise estimation requires larger samples.At n = 5000, all model-comparison criteria except marginal likelihood show some GEV advantage over logit and Cloglog; marginal likelihood requires an even larger sample under flat priors.Source: Simulated data examples · pp. 22–23, Table 10 · p. 23
Loading 1101.1373v1…